If you have fouling buildup, the patch is too thin or ball too small with that particular patch, to seal. If the ball/patch combination doesn't seal, you'll get a buildup of fouling. If you get a buildup of fouling, you need to change something. By the way, a .535" ball will show better accuracy thna a smaller ball. The ball and patch combination must be tight enough to seal. In order to load such a combination, you'll probably have to round the corners of your crown, slightly. A smooth crown allows very tight combinations to be loaded, easily.
Note Taylor is using a .022" patch with a .495" ball in his .50 Rice barrel. In that barrel, we used the .019" drill patch I used in my .40, withover size balls. In his rifle, that thinner, .019" patch was easily loaded with a 3/8" rod & without cutting the patch, using a .508" ball, .008" oversize.
Lube 1,000, which is pretty much chap-stick apparently, works too - that's just about all Round Ball uses & he doesn't have to wipe. A lot also depends on rifling depth with patch thickness, however I used to shoot a .022" denim patch with a .495" ball in a TC.50 with buttoned rifling.
I've tested pre-lubed patches with 1000, and found no loading problems, but prefer something like Track's mink oil for hunting - few shots and a tub lasts a long time. Pre-lubed patches are prohibitively expensive to purchase - as in, about $8.00 or more per hundred, here. That's ridiculous. For targets, I use a water-based lube as there is never more than 5 min. between shots. Windshield washer fluid is under $4,00 per gallon which lasts for thousands of shots. A squirt of soap, or neetsfoot oil slows evapouration. Lubed patches in a tin stay wet for a week of more, up here in the winter and for a couple days in hot weather. It is simple to re-wet them.