title: Cannot import parse_url in pyspark
body: <p>I have this sql query, for hiveql in pyspark:</p>
  
  <pre class="lang-py prettyprint-override"><code>spark.sql('SELECT split(parse_url(page.viewed_page, "PATH"), "/")[1] as path FROM df')
  </code></pre>
  
  <p>And I would like to translate into functional query like: </p>
  
  <pre class="lang-py prettyprint-override"><code>df.select(split(parse_url(col('page.viewed_page'), 'HOST')))
  </code></pre>
  
  <p>but when I import the <code>parse_url</code> function I get: </p>
  
  <pre><code>----&gt; 1 from pyspark.sql.functions import split, parse_url
  
  ImportError: cannot import name 'parse_url' from 'pyspark.sql.functions' (/usr/local/opt/apache-spark/libexec/python/pyspark/sql/functions.py)
  </code></pre>
  
  <p>Could you point me in the right direction to import the parse_url function. </p>
  
  <p>Cheers</p>