I'm not sure on the YJ, but I don't think there should be any way for any internal components to rub on the hand hole cover, other than debris inside the pump.
I'd say replace the u-joints, visually inspect the insides of the pump and go try it to see if you got rid of the vibration.