title: Scraper fails on files over ~390KB
body: <p>Does the Facebook's URL scraper have a size limitation on it? We have several books available on a website. Those that have an HMTL filesize under a certain size (~390KB) get scraped and read properly but the 4 that are larger do not. These larger items get a 200 response code and the canonical URL opens.</p>
  <p>All of these pages are built using the same template, the only differences being the size of the content within each book and the number of links each book makes to other pages on the site.</p>
  <ol>
  <li>click on canonical URL</li>
  <li>Open Firebug In Firefox or developer tools in Chrome to network tab
  3, The *.html size at &gt;~390KB for the listed failures &amp; &lt;~390K for the successes</li>
  <li>Click on &quot;See exactly what our scraper sees for your URL&quot;</li>
  <li>Blank page for failures, HTML present for successes</li>
  </ol>
  <p><strong>Failures:</strong></p>
  <ul>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftapom.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftapom.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftbgpu.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftbgpu.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fttjc.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fttjc.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftbdse.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftbdse.html</a></li>
  </ul>
  <p><strong>Successes:</strong></p>
  <ul>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fthogtc.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fthogtc.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Faabibp.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Faabibp.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftww.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftww.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftsosw.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftsosw.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fsyottc.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fsyottc.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fttigtio.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fttigtio.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Faadac.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Faadac.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fsiud.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Fsiud.html</a></li>
  <li><a href="https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftuyc.html" rel="nofollow noreferrer">https://developers.facebook.com/tools/debug/og/object?q=http%3A%2F%2Frcg.org%2Fbooks%2Ftuyc.html</a></li>
  </ul>