Why would an AC motor heavily shake when driven with certain frequencies?
Motor is free on a table and shaft is not connected to anything.


It's most likely an imbalance in the motor plus a mechanical resonance in the "mounting".

Try clamping it down to a nice solidly built table or bench, and repeat your test.  Chances are that the problem will go away, or at least be minimized and shifted in frequency.