title: Pyspark command not recognised
body: <p>I have anaconda installed and also I have downloaded Spark 1.6.2. I am using the following instructions from this answer to configure spark for Jupyter <a href="https://stackoverflow.com/questions/33064031/link-spark-with-ipython-notebook">enter link description here</a></p>
  
  <p>I have downloaded and unzipped the spark directory as </p>
  
  <pre><code>~/spark
  </code></pre>
  
  <p>Now when I cd into this directory and into bin I see the following</p>
  
  <pre><code>SFOM00618927A:spark $ cd bin
  SFOM00618927A:bin $ ls
  beeline         pyspark         run-example.cmd     spark-class2.cmd    spark-sql       sparkR
  beeline.cmd     pyspark.cmd     run-example2.cmd    spark-shell     spark-submit        sparkR.cmd
  load-spark-env.cmd  pyspark2.cmd        spark-class     spark-shell.cmd     spark-submit.cmd    sparkR2.cmd
  load-spark-env.sh   run-example     spark-class.cmd     spark-shell2.cmd    spark-submit2.cmd
  </code></pre>
  
  <p>I have also added the environment variables as mentioned in the above answer to my .bash_profile and .profile </p>
  
  <p>Now in the spark/bin directory first thing I want to check is if pyspark command works on shell first. </p>
  
  <p>So I do this after doing cd spark/bin</p>
  
  <pre><code>SFOM00618927A:bin $ pyspark
  -bash: pyspark: command not found
  </code></pre>
  
  <p>As per the answer after following all the steps I can just do </p>
  
  <pre><code>pyspark 
  </code></pre>
  
  <p>in terminal in any directory and it should start a jupyter notebook with spark engine. But even the pyspark within the shell is not working forget about making it run on juypter notebook</p>
  
  <p>Please advise what is going wrong here. </p>
  
  <p>Edit: </p>
  
  <p>I did </p>
  
  <pre><code>open .profile 
  </code></pre>
  
  <p>at home directory and this is what is stored in the path. </p>
  
  <pre><code>export PATH=/Users/854319/anaconda/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Library/TeX/texbin:/Users/854319/spark/bin
  export PYSPARK_DRIVER_PYTHON=ipython
  export PYSPARK_DRIVER_PYTHON_OPTS='notebook' pyspark
  </code></pre>