File, don't sand. If you must sand, use a block. Do not let your file or sanding block bear on only one, wood or metal, ever. Work them together always. Be aware of the grain direction, and the highs and lows, and work it where appropriate. They say file towards the metal to keep metal bits from getting in the wood, but personally I never had a problem with that.