Force system to always ask for wifi password
If you are rooted you could just run the command chmod 0440 /data/misc/wifi/wpa_supplicant.conf. Before you do it you should first delete the WiFi network. Also make sure that you have all other WiFi networks saved because after you ran this command you won't save any other network again until you chmodded the file to r+w again.