Is electrical tape enough to insulate contact that may be touching wall?
You can use the other contact not the common for the hot and then there would be no connection to the other contact point when the switch is in the off position but will work just fine just switch the hot to the other contact and the load to the common and you don't even need tape on the other side.