title: Does Spark dataset.write() result in the rows being collected at the driver node?
body: <p>I am trying to fine tune the performance a spark job that writes the results of a processed data set (on cluster) to the HDFS and also to a relational database. I am using dataset.write().jdbc() and dataset.write().csv() methods respectively. I am wondering if these methods will result in all the rows being collected to the driver node, thus impacting the performance of the job ?</p>