title: Using Python and Beautiful Soup to pickup texts on not a direct webpage
body: <p>I am trying to do the following:</p>
  
  <ol>
  <li>pickup texts on page (not the same as browser open)</li>
  <li>handle multiple pages</li>
  </ol>
  
  <p>The case is that:</p>
  
  <p>I am trying to use Python and Beautifulsoup to pick up a list of Dutch
  companies on the website <a href="http://www.fenex.nl" rel="nofollow noreferrer">http://www.fenex.nl</a>.</p>
  
  <p>I tried below keys however none of them worked out.</p>
  
  <pre><code>soup.find_all('span')
  soup.find_all('a')
  soup.find_all('td')
  soup.find_all('tr')
  soup.find_all("tr",{"class":"even"})
  </code></pre>
  
  <p>Then I found from the main page, tab "Vind een expediteur" then "Toon
  alle leden", it leads to <a href="http://www.fenex.nl/over-fenex/ledenlijst/zoekresultaat-ledenlijst" rel="nofollow noreferrer">this member page</a>. However actually when directly key in this web address, it doesn't go to the member list page.</p>
  
  <p>So how can I pick up the list of members?</p>
  
  <p>Another very important question is: The pages lasts to 45, and maybe in future it changes. How can I have the Python code know to pick them page by page?</p>