Analog Bistable Memory
Look for bistable reed switches. They are available "naked" and with a coil winding to make a bistable relay. Small and relatively cheap. About $1 a piece. If the pass channel should be conducting though the device has no power, there's no way around such switches.

The only reasonable alternative without using a battery is using a Gold Cap for the power source and ultra-low-power CMOS circuits.