title: Which configuration options are preferred in spark?
body: <p>I wanted to enquire that which configuration option is given priority in spark? Is it the configuration file or the options we manually specify when running the spark-submit shell?
  What if I have different options for executor memory in my configuration file and I specify a different value while running the spark-submit shell?</p>