I've eliminated most of my cleaning between shots by using, depending on which rifle I'm shooting, either moose milk lube (murphy's oil soap, alcohol, ballistol) or a pretty wet spit patch. The loading process pushes fouling from the last shot down atop the new powder charge, but when fired, the ball goes out through a clean bore. (Wet spit patching has obvious risks with respect to rust for hunting, but for shooting in a match it's okay.)
As to finding an accurate load, keep shooting off bags. I'd go to a fabric store, like JoAnns, and buy about 1/3 yard of a couple of different thickness of pillow ticking (so once I found the magic patching, I could buy more of it). Then, armed with .490 and .495 balls, two thicknesses of ticking, and two or three lubes (e.g. bore butter, spit, moosemilk), start trying the different combinations of each, 3 to 5 shot groups until I found a combination that produced somewhere around a 1" group or less at 50 yds. (Lay hands on a copy of Dutch Schoulz's Accuracy System package, and he'll go into more detail on how to systematically work up a load, but the gist of it is vary one load parameter at a time and once you've found the 'best' value for that parameter, don't change it ever - just work on finding the best values for the other parameters.)
Good luck. SCL