title: 100,0000 million rest api call to be made in python
body: <p>I have a list with 300 million url's .I need to invoke async rest api calls with this url's.I dont require the responses.
      I tried to implement this with twisted.when the list grows with more than 1000 url's I am getting error.Please suggest me how this could be achieved</p>
  
  <pre><code>Please find my code 
  
  # start of my program
  from twisted.web import client
  from twisted.internet import reactor, defer
  #list of urls to be invoked
  urls = [
   'http://test.com/apiname/?s=85465&amp;ts=1370591808', 
   'http://test.com/apiname/?s=85465&amp;ts=1370591808', 
   'http://test.com/apiname/?s=85465&amp;ts=1370591808', 
   'http://test.com/apiname/?s=85465&amp;ts=1370591808', 
   'http://test.com/apiname/?s=85465&amp;ts=1370591808', 
   'http://test.com/apiname/?s=85465&amp;ts=1370591808', 
   'http://test.com/apiname/?s=85465&amp;ts=1370591808', 
   'http://test.com/apiname/?s=85465&amp;ts=1370591808'
  ]
  #list of urls
  
  #the call back
  def finish(results):
      for result in results:
      print 'GOT PAGE', len(result), 'bytes'
      reactor.stop()
  
  
  waiting = [client.getPage(url) for url in urls]
  defer.gatherResults(waiting).addCallback(finish)
  
  reactor.run()
  </code></pre>