title: How Can I Scrape Data From Websites Don't Return Simple HTML
body: <p>I have been using requests and BeautifulSoup for python to scrape html from basic websites, but most modern websites don't just deliver html as a result. I believe they run javascript or something (I'm not very familiar, sort of a noob here). I was wondering if anyone knows how to, say , search for a flight on google flights and scrape the top result aka the cheapest price??</p>
  
  <p>If this were simple html, I could just parse the html tree and find the text result, but this does not appear when you view the "page source". If you inspect the element in your browser, you can see the price inside hmtl tags as if you were looking at the regular page source of a basic website.</p>
  
  <p>What is going on here that the inspect element has the html but the page source doesn't? And does anyone know how to scrape this kind of data?</p>
  
  <p>Thanks so much!</p>
  
  <p><a href="https://i.stack.imgur.com/XP00B.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/XP00B.png" alt="Inspect Element"></a>
  <a href="https://i.stack.imgur.com/vZtz6.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/vZtz6.png" alt="Javascript?"></a></p>