Scrapy run from Python
Question: I am trying to run Scrapy from Python. I'm looking at this code which
([source](http://doc.scrapy.org/en/0.16/topics/practices.html)):

    
    
    from twisted.internet import reactor
    from scrapy.crawler import Crawler
    from scrapy.settings import Settings
    from scrapy import log
    from testspiders.spiders.followall import FollowAllSpider
    
    spider = FollowAllSpider(domain='scrapinghub.com')
    crawler = Crawler(Settings())
    crawler.configure()
    crawler.crawl(spider)
    crawler.start()
    log.start()
    reactor.run() # the script will block here
    

My issue is that I'm confused on how to adjust this code to run my own spider.
I have called my spider project "spider_a" which specifies the domain to crawl
within the spider itself.

What I am asking is, if I run my spider with the following code:

    
    
    scrapy crawl spider_a
    

How do I adjust the example python code above to do the same?


Answer: Just import it and pass to `crawler.crawl()`, like:

    
    
    from testspiders.spiders.spider_a import MySpider
    
    spider = MySpider()
    crawler.crawl(spider)
    

