title: Is there any way to skip integrity check while saving a table in azure using spark?
body: <p>I am reading ~200GB of text from blob storage and want to save it as a table. I am able to read it fine and I am also able to store parts of it but when I am trying to store all the data I get this error:</p>
  <pre><code>hadoop_azure_shaded.com.microsoft.azure.storage.StorageException: Blob data corrupted (integrity check failed), Expected value is OZ7mBgD2p9cD7aP0L44mPQ==, retrieved weqbVYHNRKNtv1FPZcc1LQ==
  at hadoop_azure_shaded.com.microsoft.azure.storage.blob.BlobInputStream.readInternal(BlobInputStream.java:528)
  </code></pre>
  <p>Is there any way to skip the integrity check and just force it to save it as a table regardless? Or is there any way to fix this without removing parts of the data?</p>
  <p>Alternatively, is there a way of seeing which data is &quot;corrupt&quot; so that I can remove it from the blob?</p>