Create a non-hdfs csv from spark dataframe
If you have 45 million records you will likely need to create a set of csv files which spark will do automatically.  Depending on where you want to save the data the path will vary.  For example if you wanted to write to S3 you would provide a path like this.

df.write.csv("s3://my-bucket/path/to/folder/")

You may also want to manually repartition the data before writing to get an exact number of output files.
I want to create a non-hdfs .csv file using a spark DataFrame. How can do it ? 
The purpose of this non-hdfs .csv file is to use read_csv() on it and load it back to a pandas DataFrame.
I tried using toPandas() but I have 45 million records in my spark DataFrame and its very slow.