Mosfet reverse switch
If I understand your requirements correctly, then make these changes and try it:

Eliminate R1.  Connect the gate directly to the bottom end of SW1.  When the switch is pressed, the gate will be tied directly to the source.  This will assure that the FET is off.

Increase R2 to 10 K.  This is optional; it reduces the current drawn when the switch is closed.  In fact, R2 could be even larger, such as 47 K or even 100 K, but then the circuit is more susceptible to noise.


Note:  That FET is not a logic-level type.  Its ON resistance is not characterized in the tables for a gate voltage (Vgs) of only -3 V.  You might need a different FET, depending on what kind of load is connected to the drain (output).