Aggregated javascript contains binary data, breaks site
Turns out the problem was caused by an external javascript file that had been added through drupal_add_js without specifiying it being external. In my case specifically the pinit module for Pinterest was the culprit.

The external server had recently enabled http gzip compression, so the end result was gzipped data being straight up being concatenated into the js aggregation.