title: Accessing variables when scraping website
body: <p>I'm currently trying to scrape a website (url in code below), however when I pull out the section of html I'm looking to work with, all I get is the variable names of the information I'm looking for. The actual values for the variables are present when I manually inspect the page's html but I assume when I scrape the page that all I see is the website referencing variables from elsewhere.</p>
  <p>I'm hoping someone can help me try to access this information. I have tried just scraping the website's html using selenium, however I seem just get back the same html that I scrape when using requests (maybe I'm doing it incorrectly).</p>
  <p>This is a refined version of my code:</p>
  <pre><code>import scrapy
  from scrapy import Selector
  import requests
  
  headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.95 Safari/537.36'}
  
  
  url = 'https://groceries.aldi.ie/en-GB/drinks/Beer-Ciders?sortDirection=asc&amp;page=1'
  html = requests.get(url, headers=headers).content
  sel = Selector(text=html)
  
  html_info = (sel.xpath('//*[@id=&quot;vueSearchResults&quot;]/div/div[1]/div/div[4]/a').extract())
  
  print(html_info)
  </code></pre>
  <p>This then returns the following:</p>
  <pre><code>['&lt;a data-qa=&quot;search-product-title&quot; v-bind:href=&quot;Product.Url&quot; v-bind:title=&quot;Product.FullDisplayName&quot; v-bind:data-productid=&quot;Product.ProductId&quot; data-oc-click=&quot;searchProductClick&quot; class=&quot;p text-default-font&quot;&gt; {{Product.DisplayName}} &lt;/a&gt;']
  </code></pre>
  <p>From which I want to get the actual value of 'Product.FullDisplayName'. I'd appreciate it if some can point me in the right direction as to accessing this variable's information, or a way to scrape the website's html - as seen by a user traversing the webpage. Thanks!</p>