title: Pyspark: Job aborted due to stage failure: Task 3 in stage 86.0 failed 1 times Possible cause: Parquet column cannot be converted
body: <p>I am facing some issues while writing parquet files from one blob to another. below is the code I'm using.</p>
  <pre><code>df = spark.read.load(FilePath1,
                       format=&quot;parquet&quot;, modifiedAfter=datetime)
  spark.conf.set(&quot;spark.sql.parquet.enableVectorizedReader&quot;,&quot;false&quot;)
  df.coalesce(1).write.format(&quot;parquet&quot;).mode(&quot;overwrite&quot;).save(FilePath2)
  Error - 
  Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 86.0 failed 1 times, most recent failure: Lost task 3.0 in stage 86.0 (TID 282) (10.0.55.68 executor driver): com.databricks.sql.io.FileReadException: Error while reading file dbfs:file.parquet. Possible cause: Parquet column cannot be converted.
  java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.MutableInt cannot be cast to org.apache.spark.sql.catalyst.expressions.MutableLong.
  </code></pre>
  <p>any help is appreciated. Thanks.</p>