How to export a table dataframe in PySpark to csv?
try display(df) and use the download option in the results. Please note: only 1 million rows can be downloaded with this option but its really quick.
I am using Spark 1.3.1 (PySpark) and I have generated a table using a SQL query. I now have an object that is a DataFrame. I want to export this DataFrame object (I have called it "table") to a csv file so I can manipulate it and plot the columns. How do I export the DataFrame "table" to a csv file?
Thanks!