title: Pagination using scrapy
body: <p>I'm trying to crawl this website:
  <a href="http://www.aido.com/eshop/cl_2-c_189-p_185/stationery/pens.html" rel="nofollow">http://www.aido.com/eshop/cl_2-c_189-p_185/stationery/pens.html</a></p>
  
  <p>I can get all the products in this page, but how do I issue the request for "View More" link at the bottom of the page?</p>
  
  <p>My code till now is: </p>
  
  <pre><code>rules = (
      Rule(SgmlLinkExtractor(restrict_xpaths='//li[@class="normalLeft"]/div/a',unique=True)),
      Rule(SgmlLinkExtractor(restrict_xpaths='//div[@id="topParentChilds"]/div/div[@class="clm2"]/a',unique=True)),
      Rule(SgmlLinkExtractor(restrict_xpaths='//p[@class="proHead"]/a',unique=True)),
      Rule(SgmlLinkExtractor(allow=('http://[^/]+/[^/]+/[^/]+/[^/]+$', ), deny=('/about-us/about-us/contact-us', './music.html',  ) ,unique=True),callback='parse_item'),
  )
  </code></pre>
  
  <p>Any help?</p>