title: Unable to scrape ajax loaded elements on a webpage python
body: <p>I need to scrape a webpage the link to which is <a href="https://www.arrow.com/en/products/lmk107bbj475mklt/taiyo-yuden" rel="nofollow noreferrer">here</a>
  In this webpage there is a Cross Reference section that I want to scrape But when I use the python requests to collect the content of the page by below code:</p>
  <pre><code>url = 'https://www.arrow.com/en/products/lmk107bbj475mklt/taiyo-yuden'
  headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) 
  AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.77 Safari/537.36'}
  response = requests.get(url, headers=headers)
  soup = BeautifulSoup(response.text, &quot;html.parser&quot;)
  </code></pre>
  <p>The resultant content does not have that cross reference part maybe bcz its not loaded.I can scrape the rest of the html content but not the cross reference part. Now when I did the same thing with selenium it worked fine which means selenium is able to find this element after its loaded.
  Can Someone guide me how should I be able to get this done using python requests and beautifulsoup instead of selenium?</p>