With cast bullet or balls, the larger the bore, the greater the accuracy potential due to the larger bore being less demanding of perfect projectiles. Of course, with size, recoil then begins to play a part, balancing built-in accuracy with the shooter's capabilities of tolerance.
Your powder measure and horn also effect accuracy in smaller bores than in large ones, due to the smaller bores being effected with smaller and smaller variations in charge weight. A small hole in the horn or flask for pouring, will dribble powder more evenly into the measure, dropping charges more accurately. Too, the smaller the measure's diameter, the more accurate the charge thrown. In powder charge testing, I've found a .40" to .45" hole to drop charges up to 100gr. of powder within 1.0gr., high throw to low, while a 5/8" to 3/4" tapered hole measure increases the error shot to shot up to several grs. or more.
The horn and bone measures certainly look nice, but accurate, they aren't. For serious accuracy work, one must either weigh charges or use a measure that throws constant charges with small error shot to shot- a small bored measure does this. .38/55 cases, trimmed for volume, rim turned off and screw-eye in the flash-hole for the thong, throws charges within a grain for use in the .40 and .45 rifle. The new .32 will demand an even smaller measure, and a constriction in the horn to throw even more accurate charges, although 1gr. variation is probably OK. Also,the smaller measure makes getting the charge into the bore, without spillage an easier task.
This doesn't take into consideration the pressure differences made by smaller and smaller bores, where increased pressure demands tighter and tighter ball and patch combinations to seal the powder gasses behind the ball, preventing gas cutting and it's effect on accuracy.