title: Pyspark not able to read csv file with special character(ø) as delimiter
body: <p>My csv files looks like this:</p>
  <pre><code>idøageøname
  1ø25øAshutosh
  2ø21øShipra
  3ø11øNimisha
  4ø15øBhavya
  5ø7øSammridha
  </code></pre>
  <p>I am not able to read this csv file(delimiter is ø). Pyspark command below is reading complete line as one column instead of 3.</p>
  <pre><code>df = spark.read.option(&quot;header&quot;, &quot;true&quot;).option(&quot;sep&quot;, &quot;ø&quot;).csv('file_path.csv')
  </code></pre>