title: PySpark application submitting error on Yarn cluster mode and standalone mode
body: <p><strong>Environment:</strong></p>
  <pre><code>Python : 3.6.8  
  OS: CentOS 7  
  Spark: 2.4.5  
  Hadoop:2.7.7  
  Hardware: 3 computers (8 VCores available for each computer on hadoop cluster)
  </code></pre>
  <p>I constructed a simple python application. And my code is:</p>
  <pre class="lang-py prettyprint-override"><code>import numpy as np
  from pyspark.sql import SparkSession
  spark = SparkSession.builder \
          .appName('test_use_numpy') \
          .getOrCreate()
  sc = spark.sparkContext
  rdd = sc.parallelize(np.arange(100))
  rdd.saveAsTextFile('/result/numpy_test')
  spark.stop()
  </code></pre>
  <p>I packed the virtual environment as venv.zip.And I put that on hdfs. I submited the application using the command below:</p>
  <pre><code>/allBigData/spark/bin/spark-submit \
  --master yarn --deploy-mode cluster --num-executors 10 \
  --conf spark.yarn.dist.archives=hdfs:///spark/python/venv.zip#pyenv \
  --conf spark.yarn.appMasterEnv.PYSPARK_PYTHON=pyenv/venv/bin/python \
  /home/spark/workspace_python/test.py
  </code></pre>
  <p>And I got error:<br />
  <code>pyenv/venv/bin/python: error while loading shared libraries: libpython3.6m.so.1.0: cannot open shared object file: No such file or directory</code></p>
  <pre><code>20/06/23 15:09:08 ERROR yarn.ApplicationMaster: User application exited with status 127
  20/06/23 15:09:08 INFO yarn.ApplicationMaster: Final app status: FAILED, exitCode: 13, (reason: User application exited with status 127)
  pyenv/venv/bin/python: error while loading shared libraries: libpython3.6m.so.1.0: cannot open shared object file: No such file or directory
  </code></pre>
  <p>I didn't find libpython3.6m.so.1.0 in the venv.zip.But I found libpython3.6m.so.1.0 on centos. I tried to put it in venv/bin/, venv/lib/ directory，but neither of them worked. I still got the same error.<br />
  Then I tried to submit the application with the following command:</p>
  <pre><code>/allBigData/spark/bin/spark-submit \
  --master spark://master:7077 --num-executors 10 \
  --conf spark.yarn.dist.archives=/home/spark/workspace_python/venv.zip#pyenv \
  --conf spark.yarn.appMasterEnv.PYSPARK_PYTHON=pyenv/venv/bin/python \
  /home/spark/workspace_python/test.py
  </code></pre>
  <p>And I got a different error:<br />
  <code>ModuleNotFoundError: No module named 'numpy'</code></p>
  <p>Could anyone help me solve this problem?</p>