Sprue up is the only way of knowing where it is. If the patch is reasonably snug, then the sprue will come out the muzzle in the same position it was in when loaded.
If it is cocked off to one side, that will through out the balance and at some point, the ball should/will become less accurate, taking on a rotation around it's point of aim.
If the patch is so loose as to be pushed into the bore with just a thumb, then I would not be surprised the sprue will come out pointed in some other direction to which it
was introduced.
The ends of my ram-rods, loading sticks, loading rods, short starters, starting pegs, whatever you want to call them, are cupped so as to not damage the ball.
The various militaries of the world, had flat or even convex shaped ends on their steel ram-rods. In most countries, part of the 'loading drill' was to "throw" the rod 3 times
onto the loaded ctg. to ensure the ball was on the powder.
I still see some people doing this at rendezvous, not only 3 times, but until the rod almost bounces out of the bore.
I tend to not shoot near these people.