title: How can I remove all the duplicate from the links I obtain while scraping a HTML web page?
body: <p>I am trying to obtain all unique links from a webpage. Below is the code I created. Every time I run it, it says syntax error. How can I please correct it? Thanks</p>
  <hr />
  <pre><code>    uniquelinks = set()
      if links.get startswith 'None':
         continue
      if links.get startswith '/':
         continue
      if links.get startswith '#':
         continue
      if links.get startswith 'https':
         print(links('href'))
         uniquelinks.add(links('href'))
      if links.get startswith ('http'):
         print(links.get('href'))
         uniquelinks.add(links('href'))
  </code></pre>
  <hr />