iPhone Photos Geolocation Displayed in Wrong Language
Months of back and forth with Apple Support, and they've been as useless as they could over the matter. Every time I've followed they've asked for a few extra screenshots and then once I've submitted them, they've gone silent and unresponsive.

After spending lots of time on this, I managed to fix my problem. Here's what I tried, what did not work and what eventually worked: 

I tried switching the phone language several times to many different latin and non latin languages, and that did nothing. I also tried taking photos while the language was switched and it was saving them with the new language, but after reverting to English, those old tags were remaining in Arabic.

So here is what worked (and it was not so complicated to my surprise!):

Go to Settings app > General > Reset > Reset All Settings

Note that this doest NOT delete any media or data. All it does is resetting all phone settings like wallpapers, ringtones, etc. to default, without any data loss.