What do I lose when I set overlap rate to a really high value in STFT
If you don’t care about computational costs, you can start a window at each sample (e.g. 100% - 1 sample overlap).  It’s well into diminishing returns, but phase vocoder estimation methods work slightly better with greater overlap.