title: View worker / executor logs in Spark UI since 1.0.0+
body: <p>In 0.9.0 to view worker logs it was simple, they where one click away from the spark ui home page.</p>
  
  <p>Now (1.0.0+) I cannot find them.  Furthermore the Spark UI stops working when my job crashes! This is annoying, what is the point of a debugging tool that only works when your application does not need debugging.  According to <a href="http://apache-spark-user-list.1001560.n3.nabble.com/Viewing-web-UI-after-fact-td12023.html" rel="nofollow">http://apache-spark-user-list.1001560.n3.nabble.com/Viewing-web-UI-after-fact-td12023.html</a> I need to find out what my master-url is, but I don't how to, spark doesn't spit out this information at startup, all it says is:</p>
  
  <pre><code>... -Dspark.master=\"yarn-client\" ...
  </code></pre>
  
  <p>and obviously <code>http://yarn-client:8080</code> doesn't work. Some sites talk about how now in YARN finding logs has been super obfuscated - rather than just being on the UI, you have to login to the boxes to find them. Surely this is a massive regression and there has to be a simpler way??</p>
  
  <p>How am I supposed to find out what the master URL is? How can I find my worker (now called executor) logs?</p>