Switched Mono jack + battery: Make circuit when plugged in
If you are using mono 1/4 inch phone plugs, you can use a stereo jack (no switch contacts needed on the jack).
Connect the ground side of the battery to the ring terminal of the jack rather than to Ground.  When you insert the plug, the ring contact of the jack will touch the sleeve of the plug, completing the battery connection to Ground.