Using two switches to each send current in opposite directions
You could use a reversible motor driver circuit using a few transistors. In this example (from here), just tie the momentary switches to A and to B, respectively and replace the DC motor in the circuit with your solenoid.