title: How to schedule spider to run every 5 minutes?
body: <p>I been trying to figure out how to schedule my scrapy spider for days now without any luck. ( I tried everything from  Windows Task Scheduler to scrapy-do lib but nothing have worked on my <strong>MAIN.PY</strong> )</p>
  
  <p>( my main goal is to schedule my spider to gather data from my spider <strong>NewsSpider</strong> to mySQL <strong>news_db</strong> database every 5 minutes )</p>
  
  <p>Please look at my script as its a bit modified and change it if needed. I really want this to work.</p>
  
  <p><strong>MAIN.PY</strong></p>
  
  <pre><code>from scrapy import cmdline
  cmdline.execute("scrapy crawl news".split())
  </code></pre>
  
  <p><strong>NEWS_SPIDER.PY</strong></p>
  
  <pre><code>import scrapy
  from ..items import WebspiderItem
  
  
  class NewsSpider(scrapy.Spider):
      name = 'news'
      start_urls = [
          'https://www.coindesk.com/feed'
      ]
  
      def parse(self, response):
          pub_date = response.xpath('//pubDate/text()').extract()[0]
          page_title = response.xpath('//title/text()').extract()[2]
          page_summary = response.xpath('//description/text()').extract()[1]
          text_link = response.xpath('//link/text()').extract()[2]
  
          item = WebspiderItem()
          item['date'] = pub_date
          item['title'] = page_title
          item['summary'] = page_summary
          item['link'] = text_link
  
          yield item
  </code></pre>
  
  <p><strong>ITEMS.PY</strong></p>
  
  <pre><code>import scrapy
  
  
  class WebspiderItem(scrapy.Item):
      # define the fields for your item here like:
      date = scrapy.Field()
      title = scrapy.Field()
      summary = scrapy.Field()
      link = scrapy.Field()
  </code></pre>
  
  <p><strong>PIPELINES.PY</strong></p>
  
  <pre><code>import mysql.connector
  
  
  class WebspiderPipeline(object):
  
      def __init__(self):
          self.create_connection()
  
      def create_connection(self):
          self.conn = mysql.connector.connect(
              host='localhost',
              user='root',
              passwd='passordpassord',
              database='news_db'
          )
          self.curr = self.conn.cursor()
  
      def process_item(self, item, spider):
          self.store_db(item)
          return item
  
      def store_db(self, item):
          self.curr.execute("""insert into news_tb values (%s, %s, %s, %s)""", (
              item['date'],
              item['title'],
              item['summary'],
              item['link']
  
          ))
          self.conn.commit()
  
  </code></pre>