title: Web scraping with Selenium not capturing full text
body: <p>I'm trying to mine quite a bit of text from a list of links using Selenium/Python.</p>
  <p>In this example, I scrape only one of the pages and that successfully grabs the full text:</p>
  <pre><code>    page = 'https://xxxxxx.net/xxxxx/September%202020/2020-09-24'
  
  driver = webdriver.Firefox()
  
  driver.get(page)
  
  elements = driver.find_element_by_class_name('text').text
  
  elements
  </code></pre>
  <p>Then, when I try to loop through the whole list of links (all the by day links on this page: <a href="https://overrustlelogs.net/Destinygg%20chatlog/September%202020" rel="nofollow noreferrer">https://overrustlelogs.net/Destinygg%20chatlog/September%202020</a>) (using the same method that worked for grabbing the text from a single page), it is not grabbing the full text:</p>
  <pre><code>for i in tqdm(chat_links):
  driver.get(i)
  #driver.implicitly_wait(200)
  elements = driver.find_element_by_class_name('text').text
  #elements = driver.find_element_by_xpath('/html/body/main/div[1]/div[1]').text
  #elements = elements.text
  temp={'elements':elements}
  chat_text.append(temp)
  </code></pre>
  <p>driver.close()</p>
  <p>chat_text</p>
  <p>My thought is that maybe it doesn't have the chance to load the whole thing, but it works on the single page. Also, the driver.get method seems meant to load the whole given page.</p>
  <p>Any ideas? Thanks, much appreciated.</p>