Problems when powering a circuit directly from Solar Panel
C2 seems way to small for your consumption and the circuit will be very unstable. I would try to use at least a capacitor rated for 25V 10000uF. Maybe even several of these in parallel.