Why does turning on my desk lamp crash my board?
The transient is getting through the regulated supply.

Try adding an inductor to the power supply positive output.

That may suppress the positive-going transient.