title: What is the correct way to use maxBytesPerTrigger in Pyspark?
body: <p>I'm using Spark readStream and setting option maxBytesPerTrigger like this: <code>temp_data = spark.readStream.format(&quot;delta&quot;).option(&quot;maxBytesPerTrigger&quot;,1000).load(raw_data_delta_table)</code>
  But my whole file is loaded in single batch. I want to load it into multiple batches. Where I'm missing out? And yeah, If I use maxFilesPerTrigger, then it's working fine. But maxBytesPerTrigger is not working.
  Thanks</p>