Definitely drawfile the sides before you send the barrel out for inletting.
I also check the fit of the plug to the barrel before I send it. Sometimes I need to move the plug in a bit, or face the back of the barrel a bit to get a better seal of plug to breech. Now is the time to do this, not after you have the barrel and tang all inlet.