title: Problem trying to run pyspark with Jupyter notebook
body: <p>I need to run pyspark with Jupyter notebook. (I use Windows 10)</p>
  <p>I tried this in Anaconda Prompt:</p>
  <pre><code>pip install spark
  pip install pyspark
  SET PYSPARK_DRIVER_PYTHON=jupyter
  SET PYSPARK_DRIVER_OPTS='notebook'
  pyspark
  </code></pre>
  <p>And returns this error:</p>
  <pre><code>Traceback (most recent call last):
    File &quot;C:\Users\User\Anaconda3\Scripts\jupyter-script.py&quot;, line 10, in &lt;module&gt;
      sys.exit(main())
    File &quot;C:\Users\User\Anaconda3\lib\site-packages\jupyter_core\command.py&quot;, line 247, in main
      command = _jupyter_abspath(subcommand)
    File &quot;C:\Users\User\Anaconda3\lib\site-packages\jupyter_core\command.py&quot;, line 134, in _jupyter_abspath
      'Jupyter command `{}` not found.'.format(jupyter_subcommand)
  Exception: Jupyter command `jupyter-C:\Users\User\Anaconda3\Scripts\find_spark_home.py` not found.
  The system cannot find the path specified.
  The system cannot find the path specified.
  </code></pre>
  <p>How can I solve it?</p>