title: _spark_metadata causing problems
body: <p>I am using Spark with Scala and I have a directory where I have multiple files.</p>
  
  <p>In this directory I have Parquet files generated by Spark and other files generated by Spark Streaming. </p>
  
  <p>And Spark streaming generates a directory <em>_spark_metadata</em>.</p>
  
  <p>The problem I am facing is when I read the directory with Spark (<code>sparksession.read.load</code>), it reads only the data generated by Spark streaming, like if the other data does not exist.</p>
  
  <p>Does someone know how to resolve this issue, I think there should be a property to force Spark to ignore the <em>spark_metadata</em> directory.</p>
  
  <p>Thank you for your help</p>