title: BeautifulSoup webscraping python. Unknown error using click() method
body: <p>I want to webscrape 10 pages of the booking.com website:</p>
  
  <p>Here is my code:</p>
  
  <pre><code>from bs4 import BeautifulSoup 
  from selenium import webdriver
  import pandas as pd
  
  url= 'https://www.booking.com/searchresults.en-gb.html?label=gen173nr-1FCAEoggJCAlhYSDNYBGgOiAEBmAEuwgEKd2luZG93cyAxMMgBDNgBAegBAfgBC5ICAXmoAgM&amp;lang=en-gb&amp;sid=aebeca0be36c2e9975167200426f126a&amp;sb=1&amp;src=searchresults&amp;src_elem=sb&amp;error_url=https%3A%2F%2Fwww.booking.com%2Fsearchresults.en-gb.html%3Flabel%3Dgen173nr-1FCAEoggJCAlhYSDNYBGgOiAEBmAEuwgEKd2luZG93cyAxMMgBDNgBAegBAfgBC5ICAXmoAgM%3Bsid%3Daebeca0be36c2e9975167200426f126a%3Btmpl%3Dsearchresults%3Bclass_interval%3D1%3Bdest_id%3D-390625%3Bdest_type%3Dcity%3Bdtdisc%3D0%3Bfrom_sf%3D1%3Bgroup_adults%3D2%3Bgroup_children%3D0%3Binac%3D0%3Bindex_postcard%3D0%3Blabel_click%3Dundef%3Bno_rooms%3D1%3Boffset%3D0%3Bpostcard%3D0%3Braw_dest_type%3Dcity%3Broom1%3DA%252CA%3Bsb_price_type%3Dtotal%3Bshw_aparth%3D1%3Bslp_r_match%3D0%3Bsrc%3Dindex%3Bsrc_elem%3Dsb%3Bsrpvid%3D9fe26fd0b0e90202%3Bss%3DMadrid%3Bss_all%3D0%3Bssb%3Dempty%3Bsshis%3D0%3Bssne%3DMadrid%3Bssne_untouched%3DMadrid%26%3B&amp;ss=Madrid&amp;is_ski_area=0&amp;ssne=Madrid&amp;ssne_untouched=Madrid&amp;city=-390625&amp;checkin_monthday=5&amp;checkin_month=12&amp;checkin_year=2018&amp;checkout_monthday=6&amp;checkout_month=12&amp;checkout_year=2018&amp;group_adults=2&amp;group_children=0&amp;no_rooms=1&amp;from_sf=1'
  chrome_options = webdriver.ChromeOptions()
  chrome_options.add_argument('--no-sandbox')
  driver = webdriver.Chrome(r"C:\Users\yefida\Desktop\Study_folder\Online_Courses\1DONE\python mega course\Project 6 - Web Scraping\chromedriver.exe")
  driver.get(url)
  
  
  soup = BeautifulSoup(html, 'html.parser')
  
  pages = [str(i) for i in range(10)]
  df = []
  for page in pages:
      html = driver.page_source
      soup = BeautifulSoup(html, 'html.parser')
      data = soup.find_all('div',{'class':'sr_item_content sr_item_content_slider_wrapper '})
      list_data = []
      for item in data:
          temp = {}
          temp['Title'] = item.find('span',{'class':'sr-hotel__name'}).text.replace('\n','')
          temp['Address'] = item.find('div',{'class':'address'}).text.replace('\n','').lstrip(' ').partition(',')[0]
  
          list_data.append(temp)
      #next page:
      df.append(pd.DataFrame(list_data,columns = list_data[0].keys()))
      driver.find_element_by_xpath('//*[@id="search_results_table"]/div[4]/div[1]/ul/li[3]/a').click()
  
  data_frame_new = pd.concat(df)
  data_frame_new.reset_index(drop=True, inplace=True)
  </code></pre>
  
  <p>But at the end I get an error, which is related to the click method of selenium:</p>
  
  <p><strong>EDIT:</strong>
          WebDriverException: Message: unknown error: Element ... is not clickable at point (670, 662). Other element would receive the click: ...
        (Session info: chrome=70.0.3538.102)
        (Driver info: chromedriver=2.42.591088 (7b2b2dca23cca0862f674758c9a3933e685c27d5),platform=Windows NT 10.0.17134 x86_64)</p>
  
  <p>As was suggested by other users, I was using find_element_by_xpath for the click method. But it's hard to understand what went wrong with the error message above. How can I fix the problem?</p>