Light switch with two wires, but with voltage between them
What you describe is normal.

When you close the switch you complete the circuit and the voltage across the switch will drop to zero.

With the switch open, there is no current flowing but the wire to the light is connected through the light to neutral. You are measuring the difference between neutral and hot (live)