Rocker switch replacement
Yes.


The switch needs to be rated at least for the voltage being switched, 125 V. PASS.
The switch needs to be rated at least for the current being switched, 4 A. Replacement is capable of 6 A. PASS.