As has been mentioned, the ramrod groove doesn't need to be straight, or parallel to the bore. It can be often an advantage for the groove and hole to be bowed or at the least not parallel to the bore. These practices were typically used on original work.
Thanks all. I can rest again.