title: AWS Glue write parquet with partitions
body: <p>I am able to write to parquet format and partitioned by a column like so:</p>
  
  <pre><code>jobname = args['JOB_NAME']
  #header is a spark DataFrame
  header.repartition(1).write.parquet('s3://bucket/aws-glue/{}/header/'.format(jobname), 'append', partitionBy='date')
  </code></pre>
  
  <p>But I am not able to do this with Glue's DynamicFrame.</p>
  
  <pre><code>header_tmp = DynamicFrame.fromDF(header, glueContext, "header")
  glueContext.write_dynamic_frame.from_options(frame = header_tmp, connection_type = "s3", connection_options = {"path": 's3://bucket/output/header/'}, format = "parquet")
  </code></pre>
  
  <p>I have tried passing the <code>partitionBy</code> as a part of <code>connection_options</code> dict, since AWS docs say for parquet Glue does not support any format options, but that didn't work.</p>
  
  <p>Is this possible, and how? As for reasons for doing it this way, I thought it was needed for job bookmarking to work, as that is not working for me currently.</p>