title: Why can't I scrape Amazon by BeautifulSoup?
body: <p>Here is my python code:</p>
  <pre><code>import urllib2
  from bs4 import BeautifulSoup
  
  page = urllib2.urlopen(&quot;http://www.amazon.com/&quot;)
  soup = BeautifulSoup(page)
  print soup
  </code></pre>
  <p>it works for google.com and many other websites, but it doesn't work for amazon.com.</p>
  <p>I can open amazon.com in my browser, but the resulting &quot;soup&quot; is still none.</p>
  <p>Besides, I find that it cannot scrape from appannie.com, either. However, rather than give none, the code returns an error:</p>
  <pre><code>HTTPError: HTTP Error 503: Service Temporarily Unavailable 
  </code></pre>
  <p>So I doubt whether Amazon and App Annie block scraping.</p>