title: pyspark select subset of files using regex/glob from s3
body: <p>I have a number files each segregated by date <code>(date=yyyymmdd)</code> on amazon s3. The files go back 6 months but I would like to restrict my script to only use the last 3 months of data. I am unsure as to whether I will be able to use regular expressions to do something like <code>sc.textFile("s3://path_to_dir/yyyy[m1,m2,m3]*")</code></p>
  
  <p>where m1,m2,m3 represents the 3 months from the current date that I would like to use.</p>
  
  <p>One discussion also suggested using something like <code>sc.textFile("s3://path_to_dir/yyyym1*","s3://path_to_dir/yyyym2*","s3://path_to_dir/yyyym3*")</code> but that doesn't seem to work for me.</p>
  
  <p>Does <code>sc.textFile( )</code> take regular expressions?  I know you can use glob expressions but I was unsure how to represent the above case as a glob expression?</p>