title: Crawling extratorrent.cc using Scrapy
body: <p>I'm trying to crawl www.extratorrent.cc using Scrapy. Below is my spider:</p>
  
  <pre><code>from scrapy.contrib.spiders import CrawlSpider, Rule
  from scrapy.contrib.linkextractors import LinkExtractor
  from extra.items import *
  
  class extraSpider(CrawlSpider):
  
  name = 'extraSpider'
  allowed_domains = ['extratorrent.cc']
  start_urls = ['http://www.extratorrent.cc/torrent']
  rules = [Rule(LinkExtractor(allow=['/\d+/\S+']), 'parse_torrent')]
  
  def parse_torrent(self, response):
      torrent = TorrentItem()
      torrent['url'] = response.url
      torrent['name'] = response.xpath("/html/body/table/tbody/tr[3]/td/table/tbody/tr/td[2]/table[2]/tbody/tr/td[2]/h1").extract()
      torrent['description'] = response.xpath("/html/body/table/tbody/tr[3]/td/table/tbody/tr/td[2]/div[4]").extract()
      torrent['size'] = response.xpath("/html/body/table/tbody/tr[3]/td/table/tbody/tr/td[2]/table[3]/tbody/tr/td[1]/table/tbody/tr[10]/td[2]").extract()        
      return torrent
  </code></pre>
  
  <p>In the generated JSON file, I just get the url variable but not the others, viz. description, size and name.</p>
  
  <p>I do not know where am I going wrong, tried experimenting by changing Xpaths, but all in vain. There is something very small thing that I'm missing out.</p>