You can safely replace the faulty PSU with out restarting the switch if the other PSU is up and running. I have done that with out a problem during production on a Nexus 5596UP. Just keep a console connection so that you could see the PSU failure is being recovered once its replaced with a new one.
