Usding a punch can cock the bearing, putting more stress on it, sometimes.
I some cases when using a used part to drive the new one in place you have to relieve the used oned so Z does not get stuck, I know of other applications where it is necessary.