title: Scrapy With Splash Only Scrapes 1 Page
body: <p>I am trying to scrape multiple URLs, but for some reason only results for 1 site show. In every case it is the last URL in start_urls that is shown.</p>
  
  <p>I believe I have the problem narrowed down to my parse function.</p>
  
  <p>Any ideas on what I'm doing wrong?</p>
  
  <p>Thanks!</p>
  
  <pre><code>class HeatSpider(scrapy.Spider):
  name = "heat"
  
  start_urls = ['https://www.expedia.com/Hotel-Search?#&amp;destination=new+york&amp;startDate=11/15/2016&amp;endDate=11/16/2016&amp;regionId=&amp;adults=2', 'https://www.expedia.com/Hotel-Search?#&amp;destination=dallas&amp;startDate=11/15/2016&amp;endDate=11/16/2016&amp;regionId=&amp;adults=2']
  
  def start_requests(self):
      for url in self.start_urls:
          yield SplashRequest(url, self.parse,
              endpoint='render.html',
              args={'wait': 8},
          )
  
  def parse(self, response):
      for metric in response.css('.matrix-data'):
          yield {
              'City': response.css('title::text').extract_first(),
              'Metric Data Title': metric.css('.title::text').extract_first(),
              'Metric Data Price': metric.css('.price::text').extract_first(),
          }
  </code></pre>
  
  <p>EDIT:</p>
  
  <p>I have altered my code to help debug. After running this code, my csv looks like this: <a href="https://i.stack.imgur.com/uAiz1.png" rel="nofollow noreferrer">csv results</a> 
  There is a row for every url, as there should be, but only one row is filled out with information. </p>
  
  <pre><code>class HeatSpider(scrapy.Spider):
  name = "heat"
  
  start_urls = ['https://www.expedia.com/Hotel-Search?#&amp;destination=new+york&amp;startDate=11/15/2016&amp;endDate=11/16/2016&amp;regionId=&amp;adults=2', 'https://www.expedia.com/Hotel-Search?#&amp;destination=dallas&amp;startDate=11/15/2016&amp;endDate=11/16/2016&amp;regionId=&amp;adults=2']
  
  def start_requests(self):
      for url in self.start_urls:
          yield SplashRequest(url, self.parse,
              endpoint='render.html',
              args={'wait': 8},
          )
  
  
  def parse(self, response):
      yield {
          'City': response.css('title::text').extract_first(),
          'Metric Data Title': response.css('.matrix-data .title::text').extract(),
          'Metric Data Price': response.css('.matrix-data .price::text').extract(),
          'url': response.url,
      }
  </code></pre>
  
  <p>EDIT 2:
  Here is the full output <a href="http://pastebin.com/cLM3T05P" rel="nofollow noreferrer">http://pastebin.com/cLM3T05P</a>
  On line 46 you can see the empty cells</p>