title: How do I remove a query from a url?
body: <p>I am using scrapy to crawl a site which seems to be appending random values to the query string at the end of each URL. This is turning the crawl into a sort of an infinite loop.</p>
  
  <p>How do i make scrapy to neglect the query string part of the URL's?</p>