title: Importing PySpark packages
body: <p>I have downloaded the <code>graphframes</code> package (from <a href="http://spark-packages.org/package/graphframes/graphframes" rel="nofollow">here</a>) and saved it on my local disk. Now, I would like to use it. So, I use the following command:</p>
  
  <pre><code>IPYTHON_OPTS="notebook --no-browser" pyspark --num-executors=4  --name gorelikboris_notebook_1  --py-files ~/temp/graphframes-0.1.0-spark1.5.jar --jars ~/temp/graphframes-0.1.0-spark1.5.jar --packages graphframes:graphframes:0.1.0-spark1.5
  </code></pre>
  
  <p>All the pyspark functionality works as expected, except for the new <code>graphframes</code> package: whenever I try to <code>import graphframes</code>, I get an <code>ImportError</code>. When I examine <code>sys.path</code>, I can see the following two paths: </p>
  
  <p><code>/tmp/spark-1eXXX/userFiles-9XXX/graphframes_graphframes-0.1.0-spark1.5.jar</code> and <code>/tmp/spark-1eXXX/userFiles-9XXX/graphframes-0.1.0-spark1.5.jar</code>, however these files don't exist. Moreover, the <code>/tmp/spark-1eXXX/userFiles-9XXX/</code> directory is empty.</p>
  
  <p>What am I missing?</p>