With a .535" ball and .022" denim patching, you are just barely getting to the bottom of the grooves, if your bore is exactly .540". The rifling, if round Rice cut, is about .016" deep, thus measures .572" groove to groove if even numbered. Your .535" ball and .022" (compressed) denim patch measures .579" numerically, thus there should be .0335" compression in the bottom of each groove.
This combination is tight enough, that you should be able to shoot all day, any weather, rain, shine, cold or hot, IF you are using enough of the oil or grease black powder lubes to keep the fouling soft.
Not being able to make the rod's mark when loading the 3rd shot, is not normal. After 10 or 20 - most assuredly.
If you wish to see my loading regime with a .45 rifle, .445" ball and .022" patch AFTER 50 shots with no wiping, send me your e-mail address in a private message and I will send you an M-4 short video. We took the video of Hatch Jack and myself loading our guns - his a 20 bore smoothbore, mine a .45 rifle. This was at the end of a day's shooting. of approximately 50 shots. It might have been 60 shots, or 45- don't remember. None of us has to wipe and we ALWAYS ensure the ball is on the powder. I have found, when using the short starter as noted in the video, that my velocities were much more consistent and averaged 100fps higher than if only seated using the rod down to the powder. The reason for this is due to the light, but consistent compression of the powder charge with exactly the same 'smack' on the starter's knob. I've been loading this way for many years now.