Getting shocked because of floating ground on psu
GND/Earth is a safety device. If you disable it, things get more unsafe. 

A lot of devices have their filters coupled to GND via some capacitor, and some current flows there. If you remove that path and replace it by a resistor (e.g. a human), then that is where the current flows instead.