title: spark No such file or directory
body: <p>Here is my code:</p>
  
  <pre><code>s3.textFile("s3n://data/hadoop/data_log/req/20160618/*")
   .map(doMap)
   .saveAsTextFile()
  </code></pre>
  
  <p>spark 1.4.1, standalone cluster</p>
  
  <p><strong>Sometimes</strong>(not always, this is important) it throws this error:</p>
  
  <pre><code>[2016-09-13 03:22:51,545: ERROR/Worker-1] err: java.io.FileNotFoundException:
  No such file or directory
  's3n://data/hadoop/data_log/req/20160618/hadoop.req.2016061811.log.0.gz'
  </code></pre>
  
  <p>But when i use </p>
  
  <pre><code>aws s3 ls s3://data/hadoop/data_log/req/20160618/hadoop.req.2016061811.log.0.gz
  </code></pre>
  
  <p>The file exists.</p>
  
  <p>How to avoid this problem?</p>