Reverse proxy causes issue with CSS links and HTTPS
Do you have any css/js aggregation module installed. If so delete the caches under sites directory. You can even try uninstalling the module to debug if that is causing the issue.
Clear Drupal caches
Ensure you do not have global $base_url hard coded to http.