title: Pyspark: How to use --files tag for multiple files while running job on Yarn cluster
body: <p>I am new to Spark and using python to write jobs using pyspark. I wanted to run my script on a yarn cluster and remove the verbose logging by sending a <code>log4j.properties</code> for setting logging level to <code>WARN</code> using <code>--files</code> tag. I have a local csv file that the script uses and i need to include this as well. How do I use <code>--files</code> tag to include both the files?</p>
  
  <p>I am using the following command:</p>
  
  <p><code>/opt/spark/bin/spark-submit --master yarn --deploy-mode cluster --num-executors 50 --executor-cores 2 --executor-memory 2G --files /opt/spark/conf/log4j.properties ./list.csv  ./read_parquet.py</code></p>
  
  <p>But I get the following error:
  <code>Error: Cannot load main class from JAR file:/opt/spark/conf/./list.csv</code>
  `</p>