title: failed spark job leaves no history
body: <p>When I use spark-submit, all successfully completed jobs leaves plenty history afterwards. When a job fails, all log seems lost. from the history link, you see</p>
  
  <p>Application application_1444757668999_0004 not found.</p>
  
  <p>from the application link, you see the logs links, but they lead to </p>
  
  <p>java.lang.Exception: Unknown container. Container either has not started or has already completed or doesn't belong to this node at all.</p>
  
  <p>The only clue I have is in nohup.out, because I ran spark-submit under nohup. That log indicates executors start to die out</p>
  
  <p>ERROR YarnScheduler: Lost executor 4</p>
  
  <p>How can I get yarn to leave logs intact so I can debug?</p>