title: Python-- webscraping for the content in "expand" button with beautifulsoup
body: <p>I am scraping a yellow page to get the name of all physiotherapists in a city. With the url I get the list of 50 physiotherapists, however, when I expand the page, the url does not change. How do I  get the full list of names?</p>
  <p>This is how I get the list of physiotherapist in city of Rostock.</p>
  <pre><code>url = 'https://www.gelbeseiten.de/Suche/Physiotherapie%20praxis/Rostock'
  req = requests.get(url, headers= header)
  soup = BeautifulSoup(req.content, 'html.parser')
  
  names = []
  
  business_name = soup.find_all('h2', attrs ={&quot;data-wipe-name&quot;:&quot;Titel&quot;})
  for name in business_name:
      
      names.append(name.get_text())
  </code></pre>
  <p>At the buttom of the url there is a button called <code>Mehr Anzeigen</code>, basically saying &quot;show more&quot;. If I click there, the number of entries for physiotherapists changes from 50-60. There are entries for 90 physiotherapists. When I click the button multiple times, showing all the entries, the button disappears. This lists all the physiotherapists in the city, I want to get this.</p>
  <p>How do I get all the entries I get after clicking &quot;show more&quot;?</p>