title: Pentaho data integration "get file names" not loading big list of files
body: <p>I have big amount (over 200k) of pdf files in a remote drive like \remote\location. I have to read all file names from that directory and insert the file names into a database.  </p>
  
  <p>I have tried "get file names" step. However it is not loading the file names and the transformation is getting stopped immediately.<br>
  I have tried with smaller number of records which are in the same remote directory, but in a sub directory. it is working fine.<br>
  However when I tried for all files(including sub directories) it is crashing.  running into out of memory.  <code>(Failed to execute runnable (java.lang.OutOfMemoryError: Java heap space))</code></p>
  
  <p>Is there a way that I can process for each 1000 files once?</p>