19. The method of claim 17 , wherein updating the URL database to include the identified first set of new URLs comprises comparing the first set of new URLs to the one or more URLs to determine if the URL database includes each of the first set of new URLs.
19. The method of claim 17 , wherein updating the URL database to include the identified first set of new URLs comprises comparing the first set of new URLs to the one or more URLs to determine if the URL database includes each of the first set of new URLs. 20. The method of claim 19 , wherein updating the URL database to include the identified first set of new URLs further comprises, if it is determined that the URL database does not include one or more of the first set of new URLs, adding the one or more of the first set of new URLs to the URL database.