How do LEDs stay on constantly?
Before you drive a current through it, a semiconductor’s population of holes and electrons is (roughly) in balance between thermal excitation that supplies them, and recombination that removes them. 

When you drive currents through the semiconductor, those processes are still working. Thermal excitation will continue to create holes, which the current can now fill to create light.