what is executor and driver in spark?
DRIVER. The driver is the process where the main method runs. First it converts the user program into tasks and after that it schedules the tasks on the executors. EXECUTORS. Executors are worker nodes' processes in charge of running individual tasks in a given Spark job.