title: How to redirect entire output of spark-submit to a file
body: <p>So, I am trying to redirect the output of an apache spark-submit command to text file but some output fails to populate file.  Here is the command I am using:</p>
  
  <pre><code>spark-submit something.py &gt; results.txt
  </code></pre>
  
  <p>I can see the output in the terminal but I do not see it in the file.  What am I forgetting or doing wrong here?</p>
  
  <p>Edit:</p>
  
  <p>If I use </p>
  
  <pre><code>spark-submit something.py | less
  </code></pre>
  
  <p>I can see all the output being piped into <code>less</code></p>