Why are temperatures within a few degrees of the all-time high actually pretty common?
the coldest temperature is -129 F, and few places ever get anywhere near that.

This is at high altitudes in Antarctica. There are very few places with weather stations (geographically) near there.
There are more places with weather stations near the hottest places, so (because mathematical statistics theorem) there are more record max readings near the global max.