Yes, everything needs working with. When you add up the manufacturing tolerances of the balls (or moulds if making your own), the bore and rifling, and the variations of fabric fibers/weaves/etc, AND the plethora of lubes available (if you do non-traditional)
Then you see why "X ball with Z patch in Y bore" doesn't always (rarely does) add up to the same fitment. This is the first thing to work out-
Fitment of the ball and patch
combo in -
your- bore.
Then you can work out the details of which lube you like best, and then work out the powder charges for best performance.
It's a process. An enjoyable and rewarding process that may take several range sessions to work out.
I suspect that you forgot a zero in your patch material specification of the OP. Personally I prefer a thicker patch to a thinner patch and will vary the ball size down to make that happen rather than use a too-thin patch. Thicker patching carries more lube and does a better job of wiping down crud from the last shot. If it's too loose, it will lead to progressively harder loadings-so there's a fine line to walk. Enjoy the process. There's a billion words here at ALR on the subject, maybe two.
Patches should be re-usable when retrieved (but they taste like all *&^% when you spit lube 'em the
second time )
I use a ball starter, some don't.