title: Scrape info of companies on Fortune 500
body: <p>I am trying to scrape company info from <a href="http://fortune.com/fortune500" rel="nofollow">http://fortune.com/fortune500</a> for my thesis. As I downloaded the web_text from the link, there were no links for parsing. However, opening the link on Chrome will automatically lead to #1 company page.</p>
  
  <p>Could someone kindly help explain to me what happened and how I can trace the links to company page from the original url? </p>