A light switch shows power going to it when in the off position
it sounds like the switch was installed in the neutral,  that should be corrected.
https://electronics.stackexchange.com/questions/518257/what-is-switched-neutral