Private files return 404 not found
Merely disabling the Fast 404 module isn't enough if you are calling fast_404_ext_check(); in settings.php.  Be sure you've removed the Fast 404-related settings from settings.php.

Due to the way private files are implemented in Drupal, you will never be able to use private files with the extension-checking features of Fast 404.