I am trying to scrape data from a table of presented as HTML using the BeautifulSoup and requests libraries but I could not get all the HTML code.

My code is as below. For brevity's sake I have not included the output.

```
from urllib.request import Request, urlopen
from urllib.error import URLError, HTTPError

url = 'https://www2.susep.gov.br/safe/Corretores/pesquisa.html'
headers = {'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36'}

#try:

#Opening 
req = Request(url, headers = headers)

#Open url
response = urlopen(req)

#Read HTML
print(response.read())

```

But the code failed to read a `<main class>` division from the HTML. There is a table on the page that is present in the that has not been read.

[![enter image description here](https://i.stack.imgur.com/TcNeH.png)](https://i.stack.imgur.com/TcNeH.png)