title: How to scrape data from a website when you need to log in?
body: <p>I’m a complete noob and trying to scrape data for the first time. I’ve watched some video’s and read a bunch of articles to learn how to scrape data. The code I’ve written so far is this:</p>
  
  <pre><code>from urllib.request import urlopen as uReq
  from bs4 import BeautifulSoup as soup
  
  my_url = 'https://mijn.makelaarsland.nl/aanbod/kaart'
  uClient = uReq(my_url)
  page_html = uClient.read()
  uClient.close()
  
  #html parser
  page_soup = soup(page_html, "html.parser")
  page_soup.body.div
  </code></pre>
  
  <p>The problem when trying to parse data is that I get this problem:</p>
  
  <pre><code>&lt;div class="login-background"&gt;&lt;/div&gt;
  </code></pre>
  
  <p>I’ve watched a bunch of videos of videos and tried to write some code to get it all working but I don’t understand it.
  Maybe someone can help me and tell me what I do wrong.</p>
  
  <p>Here might be some useful information:</p>
  
  <pre><code>This is the log in URL:
  LOGIN_URL = "https://mijn.makelaarsland.nl/inloggen"
  
  
  content-type: application/x-www-form-urlencoded
  </code></pre>
  
  <p><a href="https://i.stack.imgur.com/xhjIc.png" rel="nofollow noreferrer">An overview of the network page when I right-click on 'Inspect'</a></p>