title: Allow requests to redirect with Python to read webpage
body: <p>I am trying to load websites and read their visible text with python, but some sites in my list fail to load properly because they don't successfully redirect to the main website page. e.g. the url imfuna.com should redirect to imfuna.com/home-uk/ but it doesn't, and therefore my code only retrieves 6 words rather than the 64 it should.</p>
  
  <pre><code>import requests
  from bs4 import BeautifulSoup
  
  # error handling
  
  from requests.packages.urllib3.exceptions import InsecureRequestWarning
  requests.packages.urllib3.disable_warnings(InsecureRequestWarning)
  
  # settings
  
  headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36'}
  
  url = "http://imfuna.com"
  
  response = requests.get(url, headers=headers, verify=False)
  
  soup = BeautifulSoup(response.text, "lxml")
  
  for script in soup(["script", "style"]):
      script.extract()
  text = soup.get_text()
  lines = (line.strip() for line in text.splitlines())
  chunks = (phrase.strip() for line in lines for phrase in line.split("  "))
  text = '\n'.join(chunk for chunk in chunks if chunk)
  
  front_text_count = len(text.split(" "))
  print front_text_count
  print text
  </code></pre>
  
  <p>If you run this you only get 6 words:</p>
  
  <pre><code>6
  Imfuna Property Inventory and Inspection Apps
  </code></pre>
  
  <p>But really you should get 64 (a browser redirects to <a href="http://imfuna.com/home-uk/" rel="nofollow noreferrer">http://imfuna.com/home-uk/</a> and would see the content there).</p>
  
  <p>Anyone know how I can set requests to allow the redirect to occur and to instead parse the page at <a href="http://imfuna.com/home-uk/" rel="nofollow noreferrer">http://imfuna.com/home-uk/</a></p>
  
  <p>Thanks :)</p>