title: Spark - Local mode Vs Yarn mode
body: <p>I am aware of internals and also went through <a href="https://spark.apache.org/docs/latest/submitting-applications.html#master-urls" rel="nofollow noreferrer">https://spark.apache.org/docs/latest/submitting-applications.html#master-urls</a>.</p>
  <p>I come across the following</p>
  <pre><code>local[*]    Run Spark locally with as many worker threads as logical cores on your machine.
  </code></pre>
  <p>I am also aware of yarn cluster and client mode. Does the local means spark distribution installed locally contrary to yarn mode ( which is installed in cluster)
  And also, when I submit the following command,it seems it is submitted to the cluster as it is working fine and I didnt have a local setup. So, I am presuming it is submitted to the cluster.</p>
  <p>So, what is the difference here ?</p>
  <pre><code>spark-submit --master local[*]  word-count.py
  </code></pre>
  <p>Is it same as the following command ( as there is a &quot;local&quot; setup, here ) ?</p>
  <pre><code>spark-submit --master yarn word-count.py
  </code></pre>
  <p><em><strong># Update 1</strong></em></p>
  <p>I noticed one difference . With Yarn mode, the application details are displayed in Yarn applications page. I didnt see this in local mode.</p>
  <p>I am wondering, where does it exactly the application deployed in &quot;Local mode&quot; is getting executed. I dont have a local setup of the cluster</p>
  <p>Is the localmode by-passing the yarn cluster but still getting executed in the spark cluster ?</p>