title: Using Scrapy to crawl a public FTP server
body: <p>How can I make Scrapy crawl a FTP server that doesn't require a username and password? I've tried adding the url to the start urls, but Scrapy requires a username and password for FTP access. I've overridden <code>start_requests()</code> to provide a default one (the username 'anonymous' and a blank password works when I try it with Linux's <code>ftp</code> command), but I now get 550 responses from the server. </p>
  
  <p>What's the right way to go about crawling FTP servers with Scrapy - ideally a way that would work with all FTP servers that don't require a username or password for access?</p>