title: How can I determine which request is lazy-loading a particular section of a website?
body: <p><strong>What I am doing</strong>:</p>
  <p>Scraping Amazon products such as <a href="https://www.amazon.com.br/dp/B000F5NNKE" rel="nofollow noreferrer">https://www.amazon.com.br/dp/B000F5NNKE</a>.</p>
  <p><strong>Problem:</strong></p>
  <p>The scraper starts out fine and the pages load fully for a while. However, Amazon eventually figures out I am scraping it and, instead of blocking me, the source code it sends back as a response no longer contains the two sections in the image below, namely <strong>&quot;Descrição do produto&quot;</strong> (in black) and <strong>&quot;Informações sobre o produto&quot;</strong> (below, in orange)</p>
  <p><a href="https://i.stack.imgur.com/0PYss.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/0PYss.png" alt="&quot;Descrição do produto&quot; and &quot;Informações sobre o produto&quot; are both missing" /></a></p>
  <p><strong>What I need:</strong></p>
  <p>Changing agents and proxies only works for a while so ideally what I wanted was a way to send a request to a specific URL so that I can request these sections directly instead of trying to make Amazon include them in the source code.</p>
  <p><strong>What I have tried:</strong></p>
  <p>I have looked at the XHR tab in the Network tab of developer tools but the requests were indecipherable to me.</p>
  <p><strong>QUESTION</strong></p>
  <p>Is there another a way I can figure out exactly which request loads these sections so that I don't need to use something more drastic like Javascript rendering?</p>