I have a nail set that I have ground with flats and polished the end to drive sights in and out. I agree that the sight should be driven out toward the lock side on a right handed rifle, and also in from that side. I find the steel punch damages the sight base less than one of brass, nylon, or wood. I do the work with the barrel out of the wood and held securely in a leather pad in my machinist's vise, within the extremities of the vise's jaws, not three feet out to one end. To me that is common sense, and I hate to state the obvious.