title: Scraping all mobiles of Flipkart.com
body: <p>I am trying to scrape all the mobiles from www.flipkart.com. Now, what I have thought of doing is that I can scrape all mobiles from here. </p>
  
  <pre><code>http://www.flipkart.com/mobiles/pr?p[]=sort%3Dprice_asc&amp;sid=tyy%2C4io&amp;layout=grid 
  </code></pre>
  
  <p>Now, the problem is that, in this website I have to press '<strong>show more results</strong>' to see more results. But, how can I do this using code? I am using BeautifulSoup package in python.</p>
  
  <p>My code till now:</p>
  
  <pre><code>import bs4
  import re
  import urllib2
  import sys
  
  link = 'http://www.flipkart.com/mobiles/pr?p[]=sort%3Dprice_asc&amp;sid=tyy%2C4io&amp;layout=grid'
  response = urllib2.urlopen(link)
  thePage = response.read()
  soup = bs4.BeautifulSoup(thePage)
  allMobiles = soup.find('div', attrs={'id': 'products'})
  </code></pre>
  
  <p>I only get the first page in the output? How can I access the other pages?</p>