title: how to scrape data from websites which uses just one url
body: <p>i am a student and i'm trying to scrape data from our online register so that a discord bot can send the informations on discord, the website requires login which i was able to do with this code:</p>
  <pre><code>import requests
  from lxml import html
  
  
  session_requests = requests.session()
  login_url =&quot;url&quot;
  result = session_requests.get(login_url)
  
  
  payload = {
      &quot;txtUser&quot;: &quot;user&quot;, 
      &quot;txtPassword&quot;: &quot;pass&quot;}
  
  
  tree = html.fromstring(result.text)
  
  result = session_requests.post(
      login_url, 
      data = payload, 
      headers = dict(referer=login_url)
          )
  </code></pre>
  <p>but then when i started to scrape data i encountered an issue: the website uses just one url, to explain it better imagine if you needed to scrape data from stackoverflow.com but the url in the address bar is always just stackoverflow.com/ even when you visit other pages of the website like ask question or the bountied questions' page</p>
  <p>i don't know how i could retrieve data from something like that</p>