title: How do I change the spark.ui.port?
body: <p>I am using spark-submit and tried to do this in the jar file with <code>.setExecutorEnv("spark.ui.port", "4050")</code> on the spark context, but it still tried to hit 4040. I then tried to put a <code>--conf spark.ui.port=4050</code> after <code>spark-submit</code> and before <code>--class CLASSNAME</code>, but that didn't work either, this time saying "Error: Unrecognized option '--conf'". How do I get around this? The actual error I'm running into is that there is an active spark server that others are using that is preventing this spark-submit from starting the jetty server. It's then not hitting up other ports, so I'm trying to force it to do that.</p>