High AC voltage on Touch Sensitive Switch
You haven't provided a link or a schematic but the general scheme of things should be similar to that of Figure 1.



Figure 1. A touch dimmer circuit. (I have used this on a previous answer and have lost the source reference. It is drawn in the unique style of Elektor which I subscribed to over many decades and still do.)

Note that this has 9.4 M&Omega; resistance between the touch pad and the chip input and another 4.7 M&Omega; resistor pulling that to the '0 V' line. (The whole circuit must be treated as live. The '0 V' is just the reference point from which all voltage measurements are taken.)


The 9 M&Omega; is very close to the usual 10 M&Omega; input impedance of most digital multimeters. That means that if pin 5 is close to mains voltage you would expect to measure about half of that on your multimeter. 
The worst case current from the touch pad would be \$ \frac {V}{R} = \frac {230}{9M} = 25\ \mathrm{\mu A} \$. This is too low to cause feel.
In normal operation the input is sensitive enough to detect this small current when the circuit is coupled to ground through the capacitance of your body when you touch the switch.