Why won't my ceiling light turn off?
If you've modified any wiring recently, you may have accidentally connected two separate circuits.  Otherwise, the only thing I can think of that could cause this is a short-circuit.

Either case is (very) potentially dangerous.  If you don't feel comfortable tracking down electrical issues yourself, I would call a licensed electrician right away.