title: Login and Scrape without Selenium
body: <p>I am trying to monitor various investments I hold through a single database (mysql with an MS Access Frontend). I have sourced solution for most of them as can source the unit price / share price without needing to login to a portal. My issue is for one of my investments I can only find out the value by logging in.</p>
  <p>I have got this working through my laptop using Selenium but have my raspberry pi doing all the harvesting and Selenium is flakey on it and keeps breaking when I do updates etc.</p>
  <p>I am hoping someone may be able to direct me on what python module to use for performing the same without selenium. For my other harvesting I am using a mix of requests_html &amp; urllib.request so slightly have them as a preference but couldn't work it out. Have also attempted mechanize but no luck.</p>
  <p>I have created a test account on the website and have those details in the code however it doesn't allow access to what is behind the login but my issue is being able to submit the login details in the first place.</p>
  <pre class="lang-py prettyprint-override"><code>from selenium import webdriver
  import time
  
  browser = webdriver.Edge(r&quot;C:\Python\edgedriver\msedgedriver.exe&quot;)
  browser.get('https://app.raizinvest.com.au/login')
  
  time.sleep(4)  
  browser.find_element_by_name(&quot;email&quot;).send_keys(&quot;testaccountraiz@yahoo.com&quot;)
  browser.find_element_by_name(&quot;password&quot;).send_keys(&quot;Test4321&quot;)
  browser.find_element_by_xpath(&quot;/html/body/div/div/div[1]/div/div/div/form/div[4]/button&quot;).click()
  time.sleep(3)
  print(str(browser.find_elements_by_class_name(&quot;page-content__banner-account-value&quot;)[0].text))
  browser.close()
  </code></pre>