Skychief...
Actually, the cotton patch you put around your rifle ball is what engages the lans in your rifle's barrel. Thus, the thickness of the patch-material you use is fairly critical.
I chose my patching material by using a micrometer to measure the actual "compressed thickness" of the cotton denim patch material at the store. I checked the material's thickness by screwing the micrometer's "jaws" down HARD on the cloth to see how much the cloth would "compact" under heavy pressure.
I chose to use .016-inch cotton denim material with a .490 inch .50 caliber Hornady swagged pure lead rifle ball in my .50 caliber older CVA Hawken cap-lock.
When tightening the micrometer's "jaws" down
TIGHTLY on a single layer of the cloth, it measured just .006-inches whereas with barely tightening down and just "touching" the cloth, the cloth measures .016 inches.
When you push a lubed, patched rifle ball down your rifle's barrel, the lubed, patched ball should have a fair amount of "pressure" on the cloth so that the cloth will fairly-tightly engage the rifle barrel's lans & grooves which make up the barrel's "rifling" which, in turn, puts "spin" on the rifle ball thus helping the rifle ball "fly" more accurately into the target.
If the patching material isn't thick enough, it loosely engages the barrel's lans & grooves and doesn't impart as great a force of spin on the rifle ball which can often cause "problems" with accuracy when, in fact, the powder load is actually VERY accurate IF the patch was somewhat thicker.
Of course, if the patching material is TOO THICK, it's very difficult to push the lubed, patched rifle ball DOWN the barrel which means extra work and possible problems like NOT getting the rifle ball ALL THE WAY DOWN the barrel thus setting you up to end up with a "bulge" in your rifle's barrel because the rifle ball was NOT fully "seated" down on the black powder in the base of the barrel when you pulled the trigger and FIRED the load.
Obviously, this is NOT "good" for your rifle's barrel and is likely to cause unwanted accuracy problems PLUS a possibly ruined barrel !~!~!
The proper "feel" of a properly patched rifle ball is that it should "resist" allowing you to push it down your rifle's barrel, but not-too-much "resistance" to the point of being REALLY HARD to do. You should NOT have to beat the end of your range rod with your hand or a rubber hammer to get the ball to completely and solidly seat on the powder load. By the same token, the ball should NOT seat "easily", either.
With a little effort and, perhaps, some help from a more knowledgeable muzzle-loader shooter, you should be able to determine a proper thickness for your patches. Once you are using the "proper" thickness of your patching material, you should see a reasonable increase in your rifle's shot-to-shot accuracy IF you are doing YOUR "job" with aiming, breathing and trigger control.
I hope this helps you to do better...
Strength & Honor...
Ron T.