How to allow a motor to free spin?
The reason you are noticing it is worse at higher speeds will be because of the fly-wheel effect. The energy stored in the rotating core if proportional to the square of the angular velocity... So twice as fast = four times the energy. 


Momentarily shorting the leads will cause the motor to brake rapidly dissipating much of that energy as heat in the coil.