title: Web Scraping with Python without selenium in Freebsd
body: <p>I have question possible <code>web scraping</code> without <code>selenium</code> in <code>freebsd</code>, then page loads data very slow?
  I know are <code>beatiful soup</code> with <code>request</code>, but he just pick one request and not render java script who loads another request right?</p>
  <p>Why not selenium? My <code>freebsd</code> server have just <code>1 gb ram</code> and <code>geckodriver</code> not working with one, need at least two, but i cant upgrade my server for it.</p>
  <p>Page link is <a href="https://www.verivox.de/stromvergleich/vergleich/#/?plz=10555&amp;persons=on&amp;usage=3500&amp;bonus=OnlyCompliant&amp;profile=H0&amp;product=electricity&amp;source=1&amp;q=WzYsMCwxLDEsMSwxLDEsMiwyMCwwLDEsNzQxMTIyLCI3MTA4NSIsMSwyNDAsMjQwLDM1MDAsMCwwLDAsOTk5LC0xLC0xLC0xLDAsMCwiVG90YWxDb3N0cyIsIkFzY2VuZGluZyIsIk5vbmUiLDM4LCJBbm51YWxDb3N0VmlldyIsMF0%3D&amp;partnerid=1" rel="nofollow noreferrer">here</a></p>
  <p>I need pick up first top 20 headers. My code for it in selenium (but i need make without selenium)</p>
  <pre><code>driver.get(&quot;https://www.verivox.de/stromvergleich/vergleich/#/?plz=10555&amp;persons=on&amp;usage=3500&amp;bonus=OnlyCompliant&amp;profile=H0&amp;product=electricity&amp;source=1&amp;q=WzYsMCwxLDEsMSwxLDEsMiwyMCwwLDEsNzQxMTIyLCI3MTA4NSIsMSwyNDAsMjQwLDM1MDAsMCwwLDAsOTk5LC0xLC0xLC0xLDAsMCwiVG90YWxDb3N0cyIsIkFzY2VuZGluZyIsIk5vbmUiLDM4LCJBbm51YWxDb3N0VmlldyIsMF0%3D&amp;partnerid=1&quot;).text
  time.sleep(3)
  allheader=WebDriverWait(driver,20).until(expected.visibility_of_all_elements_located((By.CSS_SELECTOR,&quot;li[class='result-item'] .result-name-area&gt;.result-name&quot;)))
  for header in allheader:
      print(&quot;Header: &quot; + header.text)
  </code></pre>
  <p>Maybe possible get data from json? Or with beatiful soup without request or something like what? Thank you for your help.</p>
  <p>Edited
  json link where are headers top 20 are in <a href="https://www.verivox.de/api/energy/offers/electricity/postCode/10555/custom?partnerId=1" rel="nofollow noreferrer">here</a> But they post it, so need season to get what</p>