title: How to see spark executing status in yarn-cluster mode on AWS
body: <p>I'm running a spark application in yarn-cluster mode on AWS.</p>
  
  <p><a href="https://i.stack.imgur.com/tf7Cr.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/tf7Cr.png" alt="enter image description here"></a>
  <a href="https://i.stack.imgur.com/FTX8C.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/FTX8C.png" alt="enter image description here"></a></p>
  
  <p>As you see I can't get any running status from Web.</p>
  
  <p>From console I only get <code>16/05/26 10:12:01 INFO yarn.Client: Application report for application_1464256533172_0002 (state: RUNNING)</code> which just indicates it's alive.</p>
  
  <p>+++</p>
  
  <p>Here is a snapshot in yarn-client mode under the same condition.
  <a href="https://i.stack.imgur.com/kehVL.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/kehVL.png" alt="enter image description here"></a></p>
  
  <p>It seems OK. At least progress bar has been shown. But even after the finish of execution, it never changed again and still show 0/368 tasks.</p>
  
  <p>By now, I can tell only under yarn-client mode running status can be shown but never be updated... 
  So how to show an updatable status under yarn-cluster mode ....</p>