title: Scrape dynamic webpage for data using scrapy
body: <p>I am trying to scrape some data from <a href="http://www.gbig.org" rel="nofollow noreferrer">www.gbig.org</a>. It was successful to scrape the Activity summary, Activity details and Why it's green section however, the response was empty when I crawl the LEED DASHBOARD section.</p>
  <p>Specifically, I would like to get 6 scores, EA, MR, IEQ, SS, WE, and ID but these values are empty when I scrape with this xpath.</p>
  <p><a href="https://i.stack.imgur.com/MoB59.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/MoB59.png" alt="enter image description here" /></a></p>
  <pre><code>scrapy shell &quot;http://www.gbig.org/activities/leed-1000020523&quot;
  response.xpath(&quot;//*[@id='overview']/div[1]/div[1]/div/div[2]/div[2]/div[1]/div[1]/div/div/p[1]/text()&quot;).extract()
  </code></pre>
  <p>I found it is because the values that want to scrape are dynamic values, but I have no idea how to  get the values. Could you please guide me to obtain these?</p>