Storing an LED's previous state even when power is removed
You need one of these:

(source: vandykes.com)
A bit retro, but meets your requirements exactly!
The point is, there are only a few ways to remember the state of an electric circuit with no power applied, and mechanically is one of the most common. The other ways can't be done with the types of components you've listed.