In order to get a perfectly even brown, or blue, as is your case, you cannot simply steel wool the colour away and re-apply. You'll end up with something likely much worse than you now have, mostly because you have applied a whole truck load of oil and waxes.
So, your best approach is going to be to degrease it, and to do that, I'd use Comet household cleaner on a ScotchBrite pad with lots of water in your laundry sink. Dry the barrel after this, and then re-drawfile it. You may only need to use abrasive cloth in the 180 grit to 220 grit range, to get down to bright steel over the whole barrel. Don't try to brown the barrel with the breech plug in...you'll always have an area where the plug and barrel join that cannot brown properly. Plg the vent with a round toothpick or the like, and shave it off flush with the outside of the barrel.
Now, once again, de-grease the barrel - again I suggest Comet, because that's what I use and it gets the barrel clean. When you rince, water should not bead at all on the steel...it should wet the barrel completely without beading.
Dry the barrel with paper towels, and carry it to your bench where you have your V block supports already set up to receive it. Never touch the barrel with bare fingers from this point on until the barrel is browned.
Apply the solution sparingly in an even coat with one swipe...never back up and go again.
Allow the solution to fester for 24 hours if you are not using a damp box. With a damp box you can re-apply every 2 1/2 to 3hours. You can card between coats to remove the loose scale...I use a roll of heavy canvas tied tightly in the middle, and use the end of the roll to rub down the barrel. Re-apply the solution another 4 - 6 applications, carding between.
To blue, I use a stainless steel tank with a lid that I had welded up specifically for the job. Pour in enough DISTILLED WATER enough to cover the barrel. Bring it to a boil, and lower the barrel into the water with steel wire...don't forget to do the breech plug too. In 15 - 20 minutes, the brown will have turned to blue/black. Remove the barrel from the tank and let it cool. Using clean cotton gloves or paper towel;s, place the barrel back into it's V Blocks and card heavily with the canvas roll, or with a soft wire wheel (from Brownell's) made specifically for the work. You should have an even blue/black barrel with a polished surface.
Good luck, and down give up.