title: Python Request Stream
body: <p>I am trying to scrape a website that seems to dynamically downloads some data to the website. I want to scrape.</p>
  
  <p>The website starts with:</p>
  
  <pre><code>&lt;td class="border_TopRight border_Left"&gt;
      Text - "TEST_NAME
  &lt;td class="border_TopRight"&gt;
      Text - TEST_NAME_1
  &lt;td class="border_TopRight"&gt;
      Text - TEST_NAME_2
  &lt;td class="apple dataCell border_TopRight font_green" id="Number of Apples" style="color: #333333; background-color: rgb(255, 255, 255);" rel="Apples "&gt;
      Text - '-'
  </code></pre>
  
  <p>Then the website will load information in as:</p>
  
  <pre><code>&lt;td class="border_TopRight border_Left"&gt;
          Text - "TEST_NAME
      &lt;td class="border_TopRight"&gt;
          Text - TEST_NAME_1
      &lt;td class="border_TopRight"&gt;
          Text - TEST_NAME_2
      &lt;td class="apple dataCell border_TopRight font_green" id="Number of Apples" style="color: #333333; background-color: rgb(255, 255, 255);" rel="Apples "&gt;
          Text - '999999.99'
  </code></pre>
  
  <p>I am trying to use Python request and stream to get the data after it loads, but I am not having much success.</p>
  
  <pre><code>import requests
  from bs4 import BeautifulSoup
  
  tarball_url = xxxxx
  r = requests.get(tarball_url, stream=True)
  
  soup = BeautifulSoup(r)
  
  td = soup.findAll('td')
  
  for line in td:
      print(str(line.get_text()))
  </code></pre>
  
  <p>This Returns:</p>
  
  <pre><code>TEST_NAME
  TEST_NAME_1
  TEST_NAME_2
   - 
  </code></pre>
  
  <p>Is there a way I can scrape the data after the website updates the datacell? It is normally pretty fast within a few seconds.</p>