You can replace a power supply while the appliance is on.
To hot swap a power supply
Remove the power supply as follows: Press the power supply's unlock lever downwards, while simultaneously pulling on the power supply's handle.
Install a new power supply as follows: Insert the power supply into the power supply slot, while simultaneously pressing the power supply's unlock lever downwards.
