title: Reading multilingual files in Python 3.9
body: <p>I have encountered a bit of a challenge when working with a CSV file that contains about 5 languages (English, French, Spanish, German, Italian, Swedish). The aim is to merge values from OneCol (a concatenated column in my df) to different dictionaries. Another condition is to merge based on the country column (e.g. French will be checked with the FR dictionary). I am having trouble with reading the file, everything I have tried ended but in a total failure, I feel a bit exhausted. The dictionaries also contain special chars/dictionaries, in this case, are data frame which I transformed them into lists.
  The error I am getting is: <code>'ascii' codec can't decode byte 0xe4 in position 89: ordinal not in range.</code>
  My code looks something like this:</p>
  <pre><code>df['ResultG'] = np.where(df[&quot;Country&quot;].isin(['1','2','12']), f['OneCol'].apply(lambda x: ' '.join(list(set(x.split()) &amp; set(words.words())))), np.where(df[&quot;Country&quot;]=='3', df['OneCol'].apply(lambda x: ' '.join(list(set(x.split()) &amp; set(list_fr)))), &quot;Other&quot;))
  </code></pre>
  <p>I tried everything from setting the file to utf-8 to actually changing the file in Notepad++. Any ideas or suggestions are welcomed. Thank you</p>