title: Proxy IP for Scrapy framework
body: <p>I am developing a web crawling project using <strong>Python</strong> and <strong>Scrapy</strong> framework. It crawls approax <strong>10k web pages</strong> from e-commerce shopping websites. whole project is working fine but before moving the code from testing server into production server i want choose a better proxy ip provider service, so that i dont have to worry about my <strong>IP Blocking</strong> or Denied access of websites to my spiders .</p>
  
  <p>Until now i am using middleware in Scrapy to manually rotate ip from free proxy ip list available of various websites <a href="http://hidemyass.com/proxy-list/">like this</a></p>
  
  <p>Now i am confused about the options i should chosse</p>
  
  <ol>
  <li><p>Buy <strong>premium proxy list</strong> from <a href="http://www.ninjasproxy.com/">http://www.ninjasproxy.com/</a> or <a href="http://hidemyass.com/">http://hidemyass.com/</a></p></li>
  <li><p>Use <strong><a href="http://www.torproject.org.in/">TOR</a></strong></p></li>
  <li><p>Use <strong>VPN Service</strong> like <a href="http://www.hotspotshield.com/">http://www.hotspotshield.com/</a></p></li>
  <li><p>Any Option better than above three</p></li>
  </ol>