title: Scraping Javascript with "onclick"
body: <p>I am having some trouble scraping the url below:
  <a href="http://102.37.123.153/Lists/eTenders/AllItems.aspx" rel="nofollow noreferrer">http://102.37.123.153/Lists/eTenders/AllItems.aspx</a>
  I am using Python with Selenium, but have many &quot;onclick&quot; javascript events to run to get to lowest level of information.  Does anyone know how to automate this?
  Thanks</p>
  <pre><code>url = 'http://102.37.123.153/Lists/eTenders/AllItems.aspx'
  chrome_options = Options()  
  chrome_options.add_argument(&quot;--headless&quot;)  
  browser = webdriver.Chrome('c:/Users/AB/Dropbox/ITProjects/Scraping/chromedriver.exe', options=chrome_options)
  res = browser.get(url)
  time.sleep(10)
  source = browser.page_source
  soup = BeautifulSoup(source)
  for link in soup.find_all('a'):
      if link.get('href') == 'javascript:':
          print(link)
  </code></pre>