title: Code was working but now doesn't work all of a sudden - Dataframe issues
body: <p>I am not very proficient at python but my aim was to extract data from my share dealing website with the intention of analysis further down the line. The below code worked for me once and now i get an error about arrays not being the same length but they already are. this literally worked for me with no modification of the code but now suddenly its not working.</p>
  <p>Code and error below:</p>
  <pre><code>import requests
  import pandas as pd
  from bs4 import BeautifulSoup as bs
  
  pd.set_option('display.max_rows', None)
  
  
  r = requests.get(&quot;https://www.somewebsite.co.uk/shares/shares-search-results/a&quot;)
  soup = bs(r.content, features = &quot;lxml&quot;)
  a = soup.find('ul', {'class':'list-unstyled list-indent'}).find_all(&quot;strong&quot;)
  
  r3 = requests.get(&quot;https://www.somewebsite.co.uk/shares/shares-search-results/b&quot;)
  soup = bs(r3.content, features = &quot;lxml&quot;)
  b = soup.find('ul', {'class':'list-unstyled list-indent'}).find_all(&quot;strong&quot;)
  
  r5 = requests.get(&quot;https://www.somewebsite.co.uk/shares/shares-search-results/c&quot;)
  soup = bs(r5.content, features = &quot;lxml&quot;)
  c  = soup.find('ul', {'class':'list-unstyled list-indent'}).find_all(&quot;strong&quot;)
  
  
  header  = a + b + c
  
  r1 = requests.get(&quot;https://www.somewebsite.co.uk/shares/shares-search-results/a&quot;)
  soup = bs(r1.content, features = &quot;lxml&quot;)
  links = [a['href'] for a in soup.find('ul', {'class' : 'list-unstyled list-indent'}).find_all(&quot;a&quot;, href=True)]
  
  r4 = requests.get(&quot;https://www.somewebsite.co.uk/shares/shares-search-results/b&quot;)
  soup = bs(r4.content, features = &quot;lxml&quot;)
  links1 = [a['href'] for a in soup.find('ul', {'class' : 'list-unstyled list-indent'}).find_all(&quot;a&quot;, href=True)]
  
  r6 = requests.get(&quot;https://www.somewebsite.co.uk/shares/shares-search-results/c&quot;)
  soup = bs(r6.content, features = &quot;lxml&quot;)
  links2 = [a['href'] for a in soup.find('ul', {'class' : 'list-unstyled list-indent'}).find_all(&quot;a&quot;, href=True)]
  
  column2 = links + links1 + links2
  
  com_list = []
  for b in header[0:]:
      result = b.text.strip()
      com_list.append(result)
  
  com_com = pd.DataFrame({'COMPANY': com_list, 'LINKS': column2})
  print(com_com)
  </code></pre>
  <p>The error I get:</p>
  <pre><code>Traceback (most recent call last):
    File &quot;hls.py&quot;, line 42, in &lt;module&gt;
      com_com = pd.DataFrame({'COMPANY': com_list, 'LINKS': column2})
    File &quot;/usr/local/lib/python2.7/site-packages/pandas/core/frame.py&quot;, line 392, in __init__
      mgr = init_dict(data, index, columns, dtype=dtype)
    File &quot;/usr/local/lib/python2.7/site-packages/pandas/core/internals/construction.py&quot;, line 212, in init_dict
      return arrays_to_mgr(arrays, data_names, index, columns, dtype=dtype)
    File &quot;/usr/local/lib/python2.7/site-packages/pandas/core/internals/construction.py&quot;, line 51, in arrays_to_mgr
      index = extract_index(arrays)
    File &quot;/usr/local/lib/python2.7/site-packages/pandas/core/internals/construction.py&quot;, line 317, in extract_index
      raise ValueError('arrays must all be same length')
  ValueError: arrays must all be same length
  </code></pre>