title: Apache Spark: Get number of records per partition
body: <p>I want to check how can we get information about each partition such as total no. of records in each partition on driver side when Spark job is submitted with deploy mode as a yarn cluster in order to log or print on the console.</p>