title: Set PySpark Serializer in PySpark Builder
body: <p>I am using PySpark 2.1.1 and am trying to set the serializer when using Spark Submit. In my application, I initialize the SparkSession.builder as follows</p>
  
  <pre><code>print("creating spark session")
  spark = SparkSession.builder.master("yarn").appName("AppName").\
  config("driver-library-path","libPath")).\
  config("driver-java-options",driverJavaOptions).\
  enableHiveSupport().\
  config("deploy-mode","client").\
  config("spark.serializer","PickleSerializer").\
  config("spark.executor.instances",100).\
  config("spark.executor.memory","4g").\
  getOrCreate()
  </code></pre>
  
  <p>I am getting the following error</p>
  
  <pre><code>java.lang.ClassNotFoundException: PickleSerializer
  </code></pre>
  
  <p>What is the right way to initialize the serializer? I realize Pickle is default but I want to know for if I use one of the other supported serializers as well. </p>