LC circuit: can it act as an "AC battery"?
This actually exists in RF transmitters like walkie-talkies. People call them "LC tanks." You're right that the amount of energy that can be stored is quite small. The reason people use them is to store energy that can be withdrawn as oscillations at a certain frequency.

You might Google "Colpitts oscillator" or "Hartley oscillator" for more information.