12. A method comprising: maintaining a URL index comprising a plurality of URLs; parsing, using at least one processor and without user intervention, a URL from the plurality of URLs to identify a domain name associated with the URL; analyzing the domain name to determine if multiple IP addresses are associated with the domain name; comparing, if the URL includes a directory path, the directory path to a list of ISP client directory paths if multiple IP addresses are associated with the domain name; determining, based on the analysis of the domain name, whether the URL is a root URL or a leaf URL; updating the URL index to reflect the determination of whether the URL is a root URL or a leaf URL; facilitating one or more queries of the URL index; and providing, in response to the one or more queries, one or more results that reflect the determination of whether the URL is a root URL or a leaf URL.
13. The method of claim 12 , wherein determining whether the URL is a root URL or a leaf URL comprises determining that the URL is a root URL if the URL does not include a directory path.