title: Using grequests to make several thousand get requests to sourceforge, get "Max retries exceeded with url"
body: <p>I am very new to all of this; I need to obtain data on several thousand sourceforge projects for a paper I am writing. The data is all freely available in json format at the url http://sourceforge.net/api/project/name/[project name]/json. I have a list of several thousand of these URL's and I am using the following code.</p>
  
  <pre><code>import grequests
  rs = (grequests.get(u) for u in ulist)
  answers = grequests.map(rs)
  </code></pre>
  
  <p>Using this code I am able to obtain the data for any 200 or so projects I like, i.e. <code>rs = (grequests.get(u) for u in ulist[0:199])</code> works, but as soon as I go over that, all attempts are met with</p>
  
  <pre><code>ConnectionError: HTTPConnectionPool(host='sourceforge.net', port=80): Max retries exceeded with url: /api/project/name/p2p-fs/json (Caused by &lt;class 'socket.gaierror'&gt;: [Errno 8] nodename nor servname provided, or not known)
  &lt;Greenlet at 0x109b790f0: &lt;bound method AsyncRequest.send of &lt;grequests.AsyncRequest object at 0x10999ef50&gt;&gt;(stream=False)&gt; failed with ConnectionError
  </code></pre>
  
  <p>I am then unable to make any more requests until I quit python, but as soon as I restart python I can make another 200 requests.</p>
  
  <p>I've tried using <code>grequests.map(rs,size=200)</code> but this seems to do nothing.</p>