title: Spark parquet schema evolution
body: <p>I have a partitioned hdfs parquet location which is having different schema is different partition.</p>
  
  <p>Say 5 columns in first partition, 4 cols in 2nd partition. Now I try to read the base Parquet path and then filter the 2nd partition. </p>
  
  <p>This gives me 5 columns in the DF even though I have only 4 columns in Parquet files in 2nd partition. 
  When I read the 2nd partition directly, it gives correct 4 cols. How to fix this.</p>