title: Does Spark Kubernetes suport the --py-files argument?
body: <p>I'm trying to run a PySpark Job using Kubernetes. Both the main script and the py-files are hosted on Google Cloud storage.
  If I launch the Job using the standalone resource manager:</p>
  
  <pre><code>spark-submit \
  --master local \
  --deploy-mode client \
  --repositories "http://central.maven.org/maven2/" \
  --packages "org.postgresql:postgresql:42.2.2" \
  --py-files https://storage.googleapis.com/foo/some_dependencies.zip \
  https://storage.googleapis.com/foo/script.py some args
  </code></pre>
  
  <p>It works fine.
  But if I try the same using Kubernetes:</p>
  
  <pre><code>spark-submit \
  --master k8s://https://xx.xx.xx.xx  \
  --deploy-mode cluster \
  --conf spark.kubernetes.container.image=gcr.io/my-spark-image \
  --repositories "http://central.maven.org/maven2/" \
  --packages "org.postgresql:postgresql:42.2.2" \
  --py-files https://storage.googleapis.com/foo/some_dependencies.zip \
  https://storage.googleapis.com/foo/script.py  some args
  </code></pre>
  
  <p>Then the main script runs, but it can't find the modules in the dependencies files.
  I know I can copy all the files inside the Docker image but I would prefer doing it this way.</p>
  
  <p>Is this possible? Am I missing something?</p>
  
  <p>Thanks</p>