title: Running python applications through 'pyspark' is deprecated as of Spark 1.0
body: <p>Basically, I have pyspark script as follows (says in <code>spark_example.py</code>):</p>
  
  <pre><code>import os
  from pyspark import SparkConf, SparkContext
  
  conf = SparkConf().setAppName('example_app').setMaster('local[8]')
  sc = SparkContext(conf=conf)
  
  if __name__ == '__main__':
      ls = range(100)
      ls_rdd = sc.parallelize(ls, numSlices=100)
      ls_out = ls_rdd.map(lambda x: x+1).collect()
      print('output!: ', ls_out)
  </code></pre>
  
  <p>with following configuration</p>
  
  <pre><code>export SPARK_HOME=~/spark-1.6.0-bin-hadoop2.6
  export export PYSPARK_PYTHON=~/anaconda3/bin/python 
  export PYSPARK_DRIVER_PYTHON=~/anaconda3/bin/ipython
  </code></pre>
  
  <p>I can run following script <code>~/spark-1.6.0-bin-hadoop2.6/bin/pyspark spark_example.py</code>I get warning as following</p>
  
  <pre><code>WARNING: Running python applications through 'pyspark' is deprecated as of Spark 1.0.
  </code></pre>
  
  <p>I'm wondering how to properly run python script for Spark (i.e. not using <code>import pyspark</code>).</p>