Toy-like plastic strip for allowing turn-on
You could use two PCB-mounted spring battery terminals mounted next to each other, so that the spring terminals are pressing together.  They would probably have to be hand-soldered as they will try to push each other out of the board during soldering.  Then add the plastic strip during manufacture, after testing but before assembly of the case.

For example, the Keystone 590.