Very much agree with what Smylee and Candlesnffer wrote, but may I add just a bit more?
Normally we have two “loads” for a rifle, an accuracy load that is just enough or a little more powder to get the ball precisely in a nice tight group on a target and another load with more “Oomph” for hunting. For example in my .45 cal flinter, the accuracy load is 42 ˝ grains and the hunting load is 80 grains. Since I shoot, or at least used to shoot, more at targets than hunting – I set the sights for target and then “held off” for the hunting load after I shot it at other ranges to see where it grouped with the 80 grain charge. Now some folks just use a hunting load (with more Oomph) for everything and target shooting.
Bottom line is my suggestion is find what makes the rifle shoot the smallest groups for how you are going to shoot it most often and THEN file the front sight to hit on the target where you want the best groups to hit.
Gus