What is the capacitor's functionallity in a Simple oscillator where it is conntected to same terminal through both sides?
The capacitor is not connected directly to ground. The lamp on one end and the resistor on the other end keep the capacitor above ground potential.

The capacitor is providing feedback from the output to the input. This causes the circuit to oscillate.