title: How to read multiple large files in parallel using python multiprocessing?
body: <p>I have a set of large text files. Currently, I have a generator function which parse each file sequentially and yield a value for each line.</p>
  
  <pre><code>def parse(): 
      for f in files:
          for line in f:
              # parse line
              yield value
  </code></pre>
  
  <p>It takes <strong>24 hours</strong> to iterate over all files!
  I'm interested to know is it possible to read multiple files in parallel and yield results in an efficient way?</p>