title: grequests - too many open files error
body: <p>I'm trying to perform about 100k GET requests and parse the response body of each request. I thought grequests would be a good way to go, but I'm getting errors related to 'too many open files'. Here's the code:</p>
  
  <pre><code>import grequests
  
  with open("./100k-sites.csv", "r") as f:
      urls = ["http://" + line.rstrip() for line in f]
  
  rs = (grequests.get(u, timeout=1) for u in urls)
  responses = grequests.map(rs)
  
  for r in responses:
      try:
          # do something with the response body
      except:
          pass
  </code></pre>
  
  <p>anyone got experience with this? The error I'm getting is:</p>
  
  <blockquote>
    <p>requests.packages.urllib3.connection.HTTPConnection object at
    0x7f817ab36898>: Failed to establish a new connection [Errno 24] Too
    many open files</p>
  </blockquote>