Remove the language prefix from the file URL
I have fixed this issue now, since the site was on nginx, I have written the redirect rule which removes language prefix while fetching files.

Insert this line in your server configuration:

rewrite ^/fr(/.*)$ $1 last;


If your site is on Apache you can add redirect rule on your server configuration or on .htaccess file.

RewriteEngine on
RewriteRule ^fr/(.*)$ $1