title: Scrapy: load 'ready-ed' DOM instead of Source
body: <p>Page Source</p>
  
  <pre><code>&lt;html&gt;
  &lt;title&gt;Example Web&lt;/title&gt;
  &lt;script&gt;
  
  $(document).ready(function(){
      document.getElementById('output').value = "Hi There""
  }
  )
  
  &lt;/script&gt;
  
  &lt;body&gt;
  &lt;div id='output'&gt;&lt;/div&gt;
  &lt;/body&gt;
  &lt;/html&gt;
  </code></pre>
  
  <p>As expected, Page Dom when loaded will be:</p>
  
  <pre><code>&lt;html&gt;
  &lt;title&gt;Example Web&lt;/title&gt;
  &lt;script&gt;
  
  $(document).ready(function(){
      document.getElementById('output').value = "Hi There"
  }
  )
  
  &lt;/script&gt;
  
  &lt;body&gt;
  &lt;div id='output'&gt;Hi There&lt;/div&gt;
  &lt;/body&gt;
  &lt;/html&gt;
  </code></pre>
  
  <p>It seems that when crawling sites using Scrapy, the response is the Page Source, rather than Page DOM. How do I make scrapy to request for Page DOM so that i can extract the 'Hi There' string in the body?</p>