title: Selenium Python script only scrapes part of the visible information
body: <p>I am sorry for the title to better describe the problem when you visit the following website :</p>
  <p>There is a text on the right that says &quot;See all&quot;. Once you click on that a list of links to various forks pops up. I am trying to scrape the hyperlinks for those forks.</p>
  <p>One problem is that the scraper not only scrapes the link for the forks but also for the profiles. They don't use specific class nor ID for those links. So I've edited my script to calculate which result is the right one and which is not. That part works. However the script only scrapes a few links and doesn't scrape others. This confused me because at first I thought that this is caused by the element not being visible to selenium since there is scroll present. This doesn't seem to be the issue however since other links that are not scraped are normally visible. The script only scrapes the first 5 links and completely skips the rest.</p>
  <p>I am now unsure on what to do since there is not error or warning about any possible issue with the code itself.</p>
  <p>This is a short part of the code that scrapes the links.</p>
  <pre><code>driver.get(url)
  
  wait.until(ec.presence_of_element_located((By.CSS_SELECTOR, &quot;button.see-all-forks&quot;))).click()
  fork_count = wait.until(ec.presence_of_element_located((By.CSS_SELECTOR, &quot;span.jsx-3602798114&quot;))).text
  forks = wait.until(ec.presence_of_all_elements_located((By.CSS_SELECTOR, &quot;a.jsx-2470659356&quot;)))
  j = 1
  for i, fork in enumerate(forks):
      if j == 1:
          forks[i] = fork.get_attribute(&quot;href&quot;)
          print(forks[i])
      if j == 3:
          j = 1
      else:
          j += 1
  </code></pre>
  <p>In this case &quot;url&quot; variable is the link I provided above. The loop then skips 3 results after each one because every 4th one is the right one. I tried using XPath to filter out the results using the &quot;contains&quot; fuction however the names vary as the users name them on their own so this to my understanding is the only way to filter out the results.</p>
  <p>This is the output that I get.</p>
  <p>After which no results ever are printed out and the program gets terminated without errors. What is happening here and what have I missed? I am confused about why Selenium only scrapes five results after which it is terminated.</p>
  <p>Edit note - my code explained :</p>
  <p>I've set up the if statements to check for every 4th result since it's the right one however the first one is also the right one. If &quot;j!=3&quot; then add 1 to &quot;j&quot; once &quot;j=3&quot; (now appears the result) the code if &quot;j=1&quot; is ran and the right result is printed. So the right result will always be &quot;j=1&quot;.</p>