title: How to refer deltalake tables in jupyter notebook using pyspark
body: <p>I'm trying to start use <code>DeltaLakes</code> using <code>Pyspark</code>.</p>
  
  <p>To be able to use deltalake, I invoke pyspark on Anaconda shell-prompt as  —</p>
  
  <pre><code>pyspark — packages io.delta:delta-core_2.11:0.3.0
  </code></pre>
  
  <p>Here is the reference from deltalake  — <a href="https://docs.delta.io/latest/quick-start.html" rel="nofollow noreferrer">https://docs.delta.io/latest/quick-start.html</a></p>
  
  <p>All commands for delta lake works fine from Anaconda shell-prompt. </p>
  
  <p>On jupyter notebook, reference to a deltalake table gives error.Here is the code I am running on Jupyter Notebook -</p>
  
  <pre><code>df_advisorMetrics.write.mode("overwrite").format("delta").save("/DeltaLake/METRICS_F_DELTA")
  spark.sql("create table METRICS_F_DELTA using delta location '/DeltaLake/METRICS_F_DELTA'")
  </code></pre>
  
  <p>Below is the code I am using at start of notebook to connect to pyspark -</p>
  
  <pre><code>import findspark
  findspark.init()
  findspark.find()
  
  import pyspark
  findspark.find()
  </code></pre>
  
  <p>Below is the error I get:</p>
  
  <blockquote>
    <p>Py4JJavaError: An error occurred while calling o116.save.
    : java.lang.ClassNotFoundException: Failed to find data source: delta. Please find packages at <a href="http://spark.apache.org/third-party-projects.html" rel="nofollow noreferrer">http://spark.apache.org/third-party-projects.html</a></p>
  </blockquote>
  
  <p>Any suggestions?</p>