Why does my AirPort Express keep disappearing?
Save configuration and replace it with another one from those that have their radios disabled. Maybe this will be enough of a solution.

Why would this be happening? I don't know but it's either power supply or its OS crashing. Or both.