Effective way to map 15k cities in Python
Try mapping by first letters of a city that will reduce your work load
I have a data set of around 15k observations. This observations are city names from all over the world. This Data set has been populated by people from many different countries which means that i have several duplicates of the same city in different languages. see below DF extract:
city_name
bruselas
brussel
brussels
brussels
brussels  auderghem 
bruxelles
bruxelles belgium
munchen
munchenstein
munchwilen
munderkingen
mundolsheim
mungia
munguia
munich
munich
munich
munich  germany
munich  munchen 
munich rupert mayer strasse
The task is to map all cities in the DF to its english name but, becaue the cities are in different format and in different languages i am finding it very difficult to come up with a solution other than perform this task manually which is not productive as we have 15,000+ observations to go through. The final data set should look something like this(using a few of the observations above only):
city_name              mapped_city
brussels  auderghem     Brusels
bruxelles               Brusels
bruxelles belgium       Brusels
munchen                 Munich
munich  germany         Munich
Any help would be greatly appreciated