Capacitor that stores one bit of information
The big drawback of capacitors is that they leaking, due to their internal parasitic resistance (its conductance is never null).
In common IC technologies (based on silicon), they are not a good choice for storing a bit of information. That's why we use them in conjunction with a transistor in the so-called DRAM memory.

As you know as a software engineer, DRAM is refreshed multiple times per seconds to keep its state. Non-volatile memory like Flash (NAND, EEPROM ...) doesn't use capacitors. For example, EEPROM use transistors only, and the capacitive effect of a part of the transistor, the floating gate. Which is, as far as I know, different than using a pure capacitor.

You could read this page: http://en.wikipedia.org/wiki/Regenerative_capacitor_memory