title: Beautifulsoup scraping data where there a js text in the middle
body: <p>I'm trying to scrape a lot of data from the page provided below and when I inspect on a browser I see a path but, when I'm using BeautifulSoup I can't get at this data. For example I'm after the city Beijing with the path below but I'd get a None. When I print soup I can see that the html is formatted very differently (js I believe) and beautifulsoup can't handle it, so what would be the alternative for me to be able to pull data from that section. Thanks.</p>
  
  <pre><code>from bs4 import BeautifulSoup,Tag
  import urllib2
  hdr = {'Accept': 'text/html,application/xhtml+xml,*/*',"user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36"}
  url='https://www.upwork.com/freelancers/_~013dfabae39ba01678/'
  req=urllib2.Request(url,headers=hdr)
  html = urllib2.urlopen(req)
  soup=BeautifulSoup(html,"lxml")
  #when I inspect I see a path as follows, however printing the soup shows a txt/javascript..
  locality=soup.find('span',{'itemprop':'locality'})
  </code></pre>
  
  <p>In the middle of the beautifulsoup output you find all the data of interest in this snippit of var phpVars:</p>
  
  <pre><code>&lt;script type="text/javascript"&gt;
      // global Applet object
      var Applet = new function() {
          var basePath = '/freelancers';
          var phpVars = {"urchinId":"UA-62227314-1","csrfTokenCookieName":"XSRF-TOKEN","csrfTokenHeaderName":"X-Odesk-Csrf-Token","runtime_id":"0128305700c7dc55bb8","clientStatsDMetrics":true,"smfAjax":false,"userId":"424358860525125632","isVisitor":true,
  </code></pre>