What I did once was ran a tiny razor saw through the ramrod channel between the thimbles. Titebond II closed up the joint. Then adjusted the inletting slightly as required, and sanded the ramrod groove back to the proper radius with a dowel and sandpaper. The saw blade was chosen based on how much I had to close the channel.
This was for a barrel which was a hair wider at the breech and muzzle, and narrower at the waist, than the existing inlet.
It is not ideal to have to make an adjustment, but I'm satisfied with how the "fix" vanished in this case. I'm not recommending you or anyone do this, just indicating it has been done. Saw very carefully and cleanly. Be VERY careful with glue as you don't want it to soak into the wood in a way which will cause finish issues.
Gerald