Hi,
Part of your problem is your mortice is so shallow. I am guessing, your sideplate is pretty thin. Even if the bottom of the mortice was perfect, compression of the wood at the bolts could flex the plate. I suspect a thicker plate and deeper mortice will resolve your problem.
dave