title: scrapy fetching incomplete html
body: <p>I'm a retired programmer but new to scrapy.  Actually, this is my first python project so I could be doing anything wrong.</p>
  
  <p>I brought up scrapy under anaconda and started a shell with :</p>
  
  <pre><code> scrapy shell "https://sailing-channels.com/by-subscribers"
  </code></pre>
  
  <p>Looks like everything is working fine and I can get some querys to work.</p>
  
  <p>Here is my problem:
     when I enter :</p>
  
  <pre><code>response.css('body').extract()
  </code></pre>
  
  <p>I get:<code>['&lt;body&gt;&lt;noscript&gt;If you\'re seeing this message, that means &lt;strong&gt;JavaScript has been disabled on your browser&lt;/strong&gt;, please &lt;strong&gt;enable JS&lt;/strong&gt; to make this app work.&lt;/noscript&gt;&lt;div id="app"&gt;&lt;/div&gt;&lt;script src="//apis.google.com/js/platform.js" async&gt;&lt;/script&gt;&lt;script&gt;!function(e,a,n,t,g,c,i){e.GoogleAnalyticsObject="ga",e.ga=e.ga||function(){(e.ga.q=e.ga.q||[]).push(arguments)},e.ga.l=1*new Date,c=a.createElement(n),i=a.getElementsByTagName(n)[0],c.async=1,c.src="//www.google-analytics.com/analytics.js",i.parentNode.insertBefore(c,i)}(window,document,"script"),ga("create","UA-15981085-17","auto"),ga("require","linkid"),ga("set","anonymizeIp",!0),ga("send","pageview")&lt;/script&gt;&lt;script type="application/ld+json"&gt;{\n\t\t\t"@context": "http://schema.org",\n\t\t\t"@type": "Organization",\n\t\t\t"name": "Sailing Channels"\n\t\t\t"url": "https://www.sailing-channels.com",\n\t\t\t"logo": "https://sailing-channels.com/img/banner.png",\n\t\t\t"sameAs" : [\n\t\t\t\t"https://www.facebook.com/sailingchannels",\n\t\t\t\t"https://twitter.com/sailchannels"\n\t\t\t]\n\t    }&lt;/script&gt;&lt;script type="text/javascript" src="https://cdn.sailing-channels.com/1.15.9/main.1dad65fcb7a507930e1f.js"&gt;&lt;/script&gt;&lt;/body&gt;']</code></p>
  
  <p>My problem is I expect a lot more.   When I do an inspect on chrome I see a lot more /div sections inside <code>&lt;div id="app"&gt;&lt;/div&gt;</code></p>
  
  <p>Could someone shine some light on what I'm doing wrong?  I want to scrape the channel name, subscriber count, and views</p>
  
  <p>Thanks</p>