title: Can I get metadata of files reading by Spark
body: <p>Let's suppose we have 2 files, file#1 created at 12:55 and file#2 created at 12:58. While reading these two files I want to add a new column &quot;creation_time&quot;. Rows  belong to file#1 have 12:55 in &quot;creation_time&quot; column and Rows belong to file#2 have 12:58 in &quot;creation_time&quot;.</p>
  <pre><code>new_data = spark.read.option(&quot;header&quot;, &quot;true&quot;).csv(&quot;s3://bucket7838-1/input&quot;)
  </code></pre>
  <p>I'm using above code snippet to read the files in &quot;input&quot; directory.</p>