Yes, perhaps, with a dash of maybe as well.
Let me explain.
Are you not hitting the barn because your shots are scattered all over God's country, or are they all close together, but away from the target?
If they're scattered everywhere its not your sights but something else. If they're close together, but off the target, then you can fix it with sights.
First the sights are set for 174 Gr. FMJ MkVII ball MilSurp ammo
only. If you're shooting anything else then it'll need re-zeroing for the new ammo's trajectory.
Second it depends (as others have said) which rear sight you have.
I'm going to assume you have the screw adjustable on on the upper right of this diagram, you'll need to let us know because there are several different techniques to use depending on your rearsight.
The "battle sight" is set for 300, or 400 yds, depending on if there is a bayonet fitted or not.
Its done this way because its a battle rifle, not a target rifle so the eights are set to hit a man sized target quickly. With the 300 yd zero you aimed at his center of mass & the bullet's path would have risen up & fallen back down from point blank to 500 yds without ever leaving the man sized target. Handy for a war, but not so much for target shooting!
(The bayonet thing is similar, the British fixed bayonets at under 300 yds) so it auto-compensated for the changed point of impact!
To reset for 100yd shooting try this.
Use 180 Gr, or better still 174Gr FMJ MilSurp bullets.
Fold the "target sight" UP.
Set the moving sight block 4 clicks below "2" as indicated by the hash-mark on the side aligning with the "2" & then coming down 4 clicks.
Let us know how that works out for starters & we can get you sorted out in more detail.