18. A method comprising: maintaining a URL; identifying, using at least one processor and without user intervention, a factor with which to analyze the URL; analyzing the URL based on the factor, wherein analyzing the URL based on the factor comprises comparing the directory path to a list of ISP client directory paths to determine if the directory path is a known ISP client directory path; determining, based on the analysis of the URL, whether the URL is a root URL or a leaf URL; updating a URL index to reflect the determination of whether the URL is a root URL or a leaf URL; facilitating one or more queries of the URL index; and providing, in response to the one or more queries, one or more results that reflect the determination of whether the URL is a root URL or a leaf URL.
19. The method of claim 18 , wherein the factor comprises whether the URL is hosted on an ISP server.