title: Spark Error: invalid log directory /app/spark/spark-1.6.1-bin-hadoop2.6/work/app-20161018015113-0000/3/
body: <p><a href="https://i.stack.imgur.com/4Otwe.jpg" rel="nofollow"><img src="https://i.stack.imgur.com/4Otwe.jpg" alt="enter image description here"></a></p>
  
  <p>My spark application is failing with the above error.</p>
  
  <p>Actually my spark program is writing the logs to that directory. Both stderr and stdout are being written to all the workers.</p>
  
  <p>My program use to worik fine earlier.  But yesterday i changed the fodler pointed to SPARK_WORKER_DIR. But today i put the old setting back and restarted the spark.</p>
  
  <p>Can anyone give me clue on why i am getting this error?</p>