title: Weird behaviour when Goodreads scraping (Python)
body: <p>I'm trying to scrape Goodreads and more specifically Goodreads editions by giving some ISBNs as input. However, I get an error and not even at the same step every time of the code running process:</p>
  <pre><code>Traceback (most recent call last):
    File &quot;C:xxx.py&quot;, line 47, in &lt;module&gt;
      ed_details = get_editions_details(isbn)
    File &quot;C:xxx.py&quot;, line 30, in get_editions_details
      ed_item = soup.find(&quot;div&quot;, class_=&quot;otherEditionsLink&quot;).find(&quot;a&quot;)
  AttributeError: 'NoneType' object has no attribute 'find'
  </code></pre>
  <p>Everything should be correct, the div class is the correct one and it seems like is there for all books. I checked with every browser and the page looks the same to me. I don't know if it's because of a deprecated library or something at this point.</p>
  <pre><code>import requests
  from bs4 import BeautifulSoup as bs
  
  
  def get_isbn():
      isbns = ['9780544176560', '9781796898279', '9788845278518', '9780374165277', '9781408839973', '9788838919916', '9780349121994', '9781933372006', '9781501167638', '9781427299062', '9788842050285', '9788807018985', '9780340491263', '9789463008594', '9780739349083', '9780156011594', '9780374106140', '9788845251436', '9781609455910']
      return isbns
  
  
  def get_page(base_url, data):
      try:
          r = requests.get(base_url, params=data)
      except Exception as e:
          r = None
          print(f&quot;Server responded: {e}&quot;)
      return r
  
  
  def get_editions_details(isbn):
      # Create the search URL with the ISBN of the book
      data = {'q': isbn}
      book_url = get_page(&quot;https://www.goodreads.com/search&quot;, data)
      # Parse the markup with Beautiful Soup
      soup = bs(book_url.text, 'lxml')
  
      # Retrieve from the book's page the link for other editions
      # and the total number of editions
  
      ed_item = soup.find(&quot;div&quot;, class_=&quot;otherEditionsLink&quot;).find(&quot;a&quot;)
  
      ed_link = f&quot;https://www.goodreads.com{ed_item['href']}&quot;
      ed_num = ed_item.text.strip().split(' ')[-1].strip('()')
  
      # Return a tuple with all the informations
      return ((ed_link, int(ed_num), isbn))
  
  
  if __name__ == &quot;__main__&quot;:
      # Get the ISBNs from the user
      isbns = get_isbn()
  
      # Check all the ISBNs
      for isbn in isbns:
          ed_details = get_editions_details(isbn)
  </code></pre>