How the low inductance of short ground clip probes prevents interference?
It doesn't prevent interference. It prevents ground lead impedance. 

Simply imagine an inductor in series with your ground connection: that acts as a low-pass filter. So, high-speed currents can't be grounded, and for these, your instrument seems to float.