title: Weird characters when webscraping using Beautiful Soup
body: <p>I am trying to return html as a string from a  eshop website but get back some weird characters.  When I look at the webconsole I do not see these characters in the html.  I also do not see these characters when the html is dispalyed in a pandas dataframe in jupyter notebook.  The link is <a href="https://www.powerhousefilms.co.uk/collections/limited-editions/products/immaculate-conception-le" rel="nofollow noreferrer">https://www.powerhousefilms.co.uk/collections/limited-editions/products/immaculate-conception-le</a>.  I am also using the same method for another product on this website but only see these character on this one page.  The other pages in the site do not have this problem.</p>
  
  <pre><code>html = requests.get(url).text
  soup = BeautifulSoup(html)
  elem = soup.find_all('div', {'class': product-single_description rte'})
  s = str(elem[0])
  </code></pre>
  
  <p>s then looks like:</p>
  
  <pre><code>    &lt;div class="product-single__description rte"&gt;
  &lt;div class="product_description"&gt;
  &lt;div&gt;
  &lt;div&gt;
  &lt;div&gt;&lt;span style="color: #000000;"&gt;&lt;em&gt;THIS ITEM IS AVAILABLE TO PRE-ORDER.Â PLEASE NOTEÂ THAT YOUR PAYMENTÂ WILL BEÂ TAKEN IMMEDIATELY, AND THATÂ THE ITEMÂ WILL BE DISPATCHED JUSTÂ BEFORE THE LISTEDÂ RELEASEÂ DATE.Â &lt;/em&gt;&lt;/span&gt;&lt;/div&gt;
  &lt;div&gt;&lt;span style="color: #000000;"&gt;&lt;em&gt;Â &lt;/em&gt;&lt;/span&gt;&lt;/div&gt;
  &lt;div&gt;&lt;span style="color: #000000;"&gt;&lt;em&gt;SHOULD YOU ORDER ANY OF THEÂ ALREADY RELEASED ITEMS FROM OURÂ CATALOGUE AT THE SAME TIME AS THIS PRE-ORDER ITEM, PLEASE NOTE THATÂ YOUR PURCHASES WILL ALL BE SHIPPED TOGETHER WHENÂ THIS PRE-ORDERÂ ITEM BECOMES AVAILABLE.&lt;/em&gt;&lt;/span&gt;&lt;/div&gt;
  &lt;/div&gt;
  &lt;div&gt;&lt;span style="color: #38761d;"&gt;Â &lt;/span&gt;&lt;/div&gt;
  &lt;div&gt;
  &lt;strong&gt;(Jamil Dehlavi, 1992)&lt;/strong&gt;&lt;br/&gt;&lt;em&gt;Release date:Â 25 March 2019&lt;/em&gt;&lt;br/&gt;Limited Blu-ray Edition (World Blu-ray premiere)&lt;br/&gt;&lt;br/&gt;A Western couple (played by Melissa Leo and James Wilby) working in Pakistan visit an unconventional holy shrine to harness its spiritual powers to help them conceive a child. They are lavished with the attentions of the shrineâ€™s leader (an exceptional performance from Zia Mohyeddin â€“ &lt;em&gt;Lawrence of Arabia&lt;/em&gt;, &lt;em&gt;Khartoum&lt;/em&gt;) and her followers, but their methods and motives are not all that they seem, and the coupleâ€™s lives are plunged into darkness.&lt;br/&gt;&lt;br/&gt;This ravishing, unsettling film from director Jamil Dehlavi (&lt;em&gt;The Blood of Hussain&lt;/em&gt;, &lt;em&gt;Born of Fire&lt;/em&gt;) is a deeply personal work which raises questions of cultural and sexual identity, religious fanaticism and the abuses of power. The brand-new 2K restoration from the original negative was supervised and approved by Dehlavi and cinematographer Nic Knowland.&lt;br/&gt;&lt;br/&gt;&lt;strong&gt;INDICATOR LIMITED EDITION BLU-RAY SPECIAL FEATURES:&lt;/strong&gt;
  &lt;/div&gt;
  &lt;div&gt;
  &lt;ul&gt;
  &lt;li&gt;New 2K restoration by Powerhouse Films from the original negative, supervised and approved by director Jamil Dehlavi and cinematographer Nic Knowland&lt;/li&gt;
  &lt;li&gt;
  &lt;div&gt;Original stereo audio&lt;/div&gt;
  &lt;/li&gt;
  &lt;li&gt;
  &lt;div&gt;Alternative original mono mix&lt;/div&gt;
  </code></pre>
  
  <p>I have tried specifying the encoding but still get the weird characters.  For the 50 + products on this website only a few have this problem.</p>
  
  <p>Is there a problem with how I am scraping or possibly an easy way to clean this up.</p>
  
  <p>Thanks</p>