title: Scrape Products Information from a Ecommerce Page
body: <p>Need to Scrape Product Information from a Ecommerce Page. But page has infinite scrolling. Currently I am able to scrape only products shown without scrolling down. Below is the code for it.</p>
  
  <pre><code>require(RCurl)
  require(XML)
  require(dplyr)
  require(stringr)
  
  webpage &lt;- getURL("http://www.jabong.com/kids/clothing/girls-clothing/kids-tops-t-shirts/?source=topnav_kids")
  
  linklist &lt;- str_extract_all(webpage, '(?&lt;=href=")[^"]+')[[1]]
  linklist &lt;- as.data.frame(linklist)
  linklist &lt;- filter(linklist, grepl("\\?pos=", linklist))
  linklist &lt;- unique(linklist)
  
  a &lt;- as.data.frame(linklist)
  a[2] &lt;- "Jabong.com"
  a &lt;- add_rownames(a, "ID")
  a$V3 &lt;- gsub(" ", "", paste(a$V2, a$linklist))
  a &lt;- a[, -(1:3)]
  colnames(a) &lt;- "Links"
  </code></pre>