title: Loop For Webscraping In Selenium
body: <p>I need to scrape all the products in this page: <a href="https://www.asos.com/women/new-in/new-in-clothing/cat/?cid=2623&amp;nlid=ww%7Cnew%20in%7Cnew%20products%7Cclothing" rel="nofollow noreferrer">website</a></p>
  <p><strong>So I need to click on each photo then scrape the data inside them.</strong></p>
  <p><strong>I managed to write the script for scraping the data inside.</strong></p>
  <p>I had to extract the name, price, description,...</p>
  <p>Below is my code:</p>
  <pre><code>import scrapy
  from scrapy_selenium import SeleniumRequest
  from scrapy.selector import Selector
  from selenium.webdriver.common.keys import Keys
  from scrapy_splash import SplashRequest
  from selenium import webdriver
  from selenium.webdriver.chrome.options import Options
  from shutil import which
  
  class AsoswomennewSpider(scrapy.Spider):
      name = 'asoswomennew'
      allowed_domains = ['www.asos.com']
      start_urls = ['https://www.asos.com/monki/monki-lisa-cropped-vest-top-with-ruched-side-in-black/prd/23590636?colourwayid=60495910&amp;cid=2623']
  
  
  def __init__(self):
      chrome_option = Options()
      chrome_option.add_argument(&quot;--headless&quot;)
      chrome_path = which(&quot;chromedriver&quot;)
      driver = webdriver.Chrome(executable_path=chrome_path, options = chrome_option)
      driver.set_window_size(1920, 1080)
      driver.get('https://www.asos.com/monki/monki-lisa-cropped-vest-top-with-ruched-side-in-black/prd/23590636?colourwayid=60495910&amp;cid=2623')
  
  
  def parse(self, response):
  
             yield{
             'name':response.xpath(&quot;//div[@class='product-hero']/h1/text()&quot;).get(),
             'price':response.css('//*[contains(@class, &quot;current-price&quot;)]').get(),
             'description':response.xpath(&quot;//div[@class='product-description']/ul/li/span/text()&quot;).getall(),
             'about_me':response.xpath(&quot;//div[@class='about-me']/p/text()&quot;).getall(),
             'brand_description':response.xpath(&quot;//div[@class='brand-description']/p/text()&quot;).getall()
          }
  </code></pre>
  <p>Now I need to loop through each of the pictures then do the script above.</p>
  <p><a href="https://i.stack.imgur.com/NvCyZ.jpg" rel="nofollow noreferrer">pictures to loop</a></p>
  <p>Can someone help me please?</p>
  <p>Thanks!</p>
  <p>P.S my <strong>start_url</strong> will need to change to this one 'https://www.asos.com/women/new-in/new-in-clothing/cat/?cid=2623&amp;nlid=ww|new+in|new+products|clothing'</p>
  <p>As this is the main(home) webpage and then I will need to have a callback url for each items.</p>