title: Anyone know of a good Python based web crawler that I could use?
body: <p>I'm half-tempted to write my own, but I don't really have enough time right now.  I've seen the Wikipedia list of <a href="http://en.wikipedia.org/wiki/Web_crawler#Open-source_crawlers" rel="nofollow noreferrer">open source crawlers</a> but I'd prefer something written in Python.  I realize that I could probably just use one of the tools on the Wikipedia page and wrap it in Python.  I might end up doing that - if anyone has any advice about any of those tools, I'm open to hearing about them.  I've used Heritrix via its web interface and I found it to be quite cumbersome.  I definitely won't be using a browser API for my upcoming project.</p>
  
  <p>Thanks in advance.  Also, this is my first SO question!</p>