title: How to divide a spark dataframe into n different chunks and convert them to dataframe and append into one?
body: <p>I have a spark dataframe of 100000 rows. Is there a way to loop though 1000 rows and convert them to pandas dataframe using toPandas() and append them into a new dataframe?</p>
  <p>Directly changing this by using toPandas() is taking a very long time. There is no column by which we can divide the dataframe in a segmented fraction.</p>