title: AWS Glue: ETL to read S3 CSV files
body: <p>I want to use ETL to read data from S3. Since with ETL jobs I can set DPU to hopefully speed things up. </p>
  
  <p>But how do I do it? I tried  </p>
  
  <pre><code>import sys
  from awsglue.transforms import *
  from awsglue.utils import getResolvedOptions
  from pyspark.context import SparkContext
  from awsglue.context import GlueContext
  from awsglue.job import Job
  
  ## @params: [JOB_NAME]
  args = getResolvedOptions(sys.argv, ['JOB_NAME'])
  
  sc = SparkContext()
  glueContext = GlueContext(sc)
  spark = glueContext.spark_session
  job = Job(glueContext)
  job.init(args['JOB_NAME'], args)
  
  inputGDF = glueContext.create_dynamic_frame_from_options(connection_type = "s3", connection_options = {"paths": ["s3://pinfare-glue/testing-csv"]}, format = "csv")
  outputGDF = glueContext.write_dynamic_frame.from_options(frame = inputGDF, connection_type = "s3", connection_options = {"path": "s3://pinfare-glue/testing-output"}, format = "parquet")
  </code></pre>
  
  <p>But it appears there is nothing written. My folder looks like: </p>
  
  <p><a href="https://i.stack.imgur.com/7aXDP.png" rel="noreferrer"><img src="https://i.stack.imgur.com/7aXDP.png" alt="enter image description here"></a></p>
  
  <p>Whats incorrect? My output S3 only has a file like: <code>testing_output_$folder$</code></p>