How to turn off a circuit with a ON/OFF switch
Like this?







simulate this circuit &ndash; Schematic created using CircuitLab

That'll work just fine. Regardless of the regulator type and how many are connected to the battery.