Yeah, in a perfect world, you should not need any glue.
But if you ever use the drill press for jobs that puts a side load on the chuck/taper then it will work better, otherwise the chuck will fall off. If the taper is already damaged it will save the drill press. If it is a $100 Chinese unit, who cares.
If I had a really nice old quality drill press I would not glue the chuck on.