title: Spark Mesos Dispatcher
body: <p>My team is deploying a new Big Data architecture on Amazon Cloud. We have Mesos up and running Spark jobs.</p>
  
  <p>We are submitting Spark jobs (i.e.: jars) from a bastion host inside the same cluster. Doing so, however, the bastion host is the driver program and this is called the <a href="https://spark.apache.org/docs/latest/running-on-mesos.html#client-mode" rel="nofollow">client mode</a> (if I understood correctly).</p>
  
  <p>We would like to try the <a href="https://spark.apache.org/docs/latest/running-on-mesos.html#cluster-mode" rel="nofollow">cluster mode</a>, but we don't understand where to start the dispatcher process.</p>
  
  <p>The documentation says to start it in the cluster, but I'm confused since our masters don't have Spark installed and we use Zookeeper for master election. Starting it on a slave node is not a vailable option, since slave can fail and we don't want to expose a slave ip or public DNS to the bastion host.</p>
  
  <p>Is it correct to start the dispatcher on the bastion host?</p>
  
  <p>Thank you very much</p>