When I used a loading block, I used the long shaft of the starter to push the ball against the muzzle- holding it there with pressure, let go of the block, and smack the starter's knob with my palm- in goes the ball and the block is captured on the starter's shaft. The shaft on my .32's short starter is 6" long. I like the patched ball to be well inside the bore before pushing it down with the rifle's 5/16" rod.
The stud on the starter's knob is only for starting a patched ball into the bore, before using the long shaft to run it down that 5" to 6".
My .32 is not shooting a bit better (last time I targeted it) with a .319" mould that casts .320" X .320. I use the 8 ounce denim with that ball, measuring .020" compressed.
The .311" ball and patch prefers 35gr. 3f GOEX and the .32" ball prefers 40gr. 3F GOEX. All shooting at 50yards, rest.