title: How to run PySpark (possibly in client mode) on Mesosphere cluster?
body: <p>I am trying to run a PySpark job on a Mesosphere cluster but I cannot seem to get it to run. I understand that Mesos does not support cluster deploy mode for PySpark applications and that it needs to be run in client mode. I believe this is where the problem lies.</p>
  
  <p>When I try submitting a PySpark job I am getting the output below.</p>
  
  <pre><code>... socket.hpp:107] Shutdown failed on fd=48: Transport endpoint is not connected [107]
  </code></pre>
  
  <p>I believe that a spark job running in client mode needs to connect to the nodes directly and this is being blocked?</p>
  
  <p>What configuration would I need to change to be able to run a PySpark job in client mode?</p>