How can I reset AirPort Express to factory defaults?
I believe the full procedure is


Unplug the unit
Press and hold reset (e.g. with paper clip)
Plug the unit back into power outlet (while pressing reset)
Wait for rapid green flashing
Release reset button


From your description, it's not clear how you were managing the AC power