title: Screen scraping: getting around "HTTP Error 403: request disallowed by robots.txt"
body: <p>Is there a way to get around the following?</p>
  
  <pre><code>httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
  </code></pre>
  
  <p>Is the only way around this to contact the site-owner (barnesandnoble.com).. i'm building a site that would bring them more sales, not sure why they would deny access at a certain depth.</p>
  
  <p>I'm using mechanize and BeautifulSoup on Python2.6.</p>
  
  <p>hoping for a work-around</p>