Can't Upload JPEGs to live site (PEL error)
@lindseydiloreto in the Craft Slack gave me the solution.

For some reason, the craft/app folder got messed up in the last update. 

Re-downloading and replacing the /app folder fixed the problem