title: Writting Parquet file with append or overwrite, error File doesn't exist, Scala Spark
body: <p>When I try to write my final DF with append or overwrite mode, sometimes, I get the following error:</p>
  <pre><code>Caused by: java.io.FileNotFoundException: File file:/C:/Users/xxx/ScalaSparkProjects/Date=2019-11-02/part-xxxx2x.28232x.213.c000.snappy.parquet does not exist
  It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running 'REFRESH TABLE tableName' command in SQL or by recreating the Dataset/DataFrame involved.
  </code></pre>
  <p>And I can't understand why. This is how I am writting the DF as a parquet file:</p>
  <pre><code>df.write.mode(&quot;append&quot;)
    .partitionBy(&quot;Date&quot;)
    .format(&quot;parquet&quot;)
    .save(/data/testing/files)
  </code></pre>
  <p>Why could be happening this?</p>