title: Scraping table in python
body: <p>Could someone please help me scrape data from the big table on <a href="https://www.statsinsider.com.au/prediction-results?fbclid=IwAR18wxeCq_ygxLG1v2JEe3YqBNNS6krzNnOQULYp4IZihQY6JMgHwzpIl6o" rel="nofollow noreferrer">https://www.statsinsider.com.au/prediction-results?fbclid=IwAR18wxeCq_ygxLG1v2JEe3YqBNNS6krzNnOQULYp4IZihQY6JMgHwzpIl6o</a></p>
  
  <p>I have some foundation here: </p>
  
  <pre><code>from bs4 import BeautifulSoup
  from requests_html import HTMLSession
  session = HTMLSession()
  url = 'https://www.statsinsider.com.au/prediction-results?fbclid=IwAR18wxeCq_ygxLG1v2JEe3YqBNNS6krzNnOQULYp4IZihQY6JMgHwzpIl6o'
  r = session.get(url)
  soup=BeautifulSoup(r.html.html,'html.parser')
  stat_table = soup.find('table')
  </code></pre>
  
  <p>this outputs the following, which doesn't seem to be the entire table. Help appreciated, thanks!</p>
  
  <pre><code>&lt;table&gt;
  &lt;tbody&gt;
  &lt;tr&gt;
  &lt;th&gt;Date&lt;/th&gt;
  &lt;th class="to-hide"&gt;Sport&lt;/th&gt;
  &lt;th&gt;Team&lt;/th&gt;
  &lt;th class="to-hide"&gt;Bet Type&lt;/th&gt;
  &lt;th&gt;Odds&lt;/th&gt;
  &lt;th class="to-hide"&gt;Bet&lt;/th&gt;
  &lt;th&gt;Result&lt;/th&gt;
  &lt;th&gt;Profit/Loss&lt;/th&gt;
  &lt;/tr&gt;
  &lt;tr ng-repeat="match in recentResults"&gt;
  &lt;td&gt;{{match.Date}}&lt;/td&gt;
  &lt;td class="to-hide"&gt;{{match.Sport}}&lt;/td&gt;
  &lt;td&gt;{{match.Team}}&lt;/td&gt;
  &lt;td class="to-hide"&gt;{{match.Type}}&lt;/td&gt;
  &lt;td&gt;${{match.Odds}}&lt;/td&gt;
  &lt;td class="to-hide"&gt;${{match.Bet}}&lt;/td&gt;
  &lt;td&gt;{{match.Result}}&lt;/td&gt;
  &lt;td class="green" ng-if="match.Return &amp;gt; 0"&gt;${{match.Return}}&lt;/td&gt;
  &lt;td class="red" ng-if="match.Return &amp;lt; 0"&gt;${{match.Return}}&lt;/td&gt;
  &lt;td ng-if="match.Return == 0"&gt;&lt;/td&gt;
  &lt;/tr&gt;
  &lt;/tbody&gt;
  &lt;/table&gt;
  </code></pre>