33. An information resource taxonomy system, including: a data collector having computer system hardware components including at least one processor operating according to one or more software modules, the at least one processor and one or more software modules configured for collecting information resources from a communications network; a taxonomy generator for generating clusters of said collected information resources based on a similarity threshold value for clustering and similarity values for said collected information resources and for iteratively generating sub-clusters of said generated clusters based on the similarity threshold value for clustering and similarity values for information resources within each of said generated clusters and within each of said generated sub-clusters, wherein the generated clusters and sub-clusters provide a hierarchy of resource clusters, wherein the number of resource clusters in each level of said hierarchy is determined by content of said collected information resources; a classifier configured to classify further information resources collected from the communication network to a plurality of the resource clusters; and a component configured to maintain the coherence of the plurality of resource clusters as further information resources are classified by at least one of: (a) reducing the similarity threshold value for clustering with increasing numbers of the further collected information resources; and (b) selecting a random subset of information resources from the collected information resources; generating a new similarity threshold value for the selected random subset of information resource; and re-clustering the collected information resources using the new similarity threshold value for clustering.
33. An information resource taxonomy system, including: a data collector having computer system hardware components including at least one processor operating according to one or more software modules, the at least one processor and one or more software modules configured for collecting information resources from a communications network; a taxonomy generator for generating clusters of said collected information resources based on a similarity threshold value for clustering and similarity values for said collected information resources and for iteratively generating sub-clusters of said generated clusters based on the similarity threshold value for clustering and similarity values for information resources within each of said generated clusters and within each of said generated sub-clusters, wherein the generated clusters and sub-clusters provide a hierarchy of resource clusters, wherein the number of resource clusters in each level of said hierarchy is determined by content of said collected information resources; a classifier configured to classify further information resources collected from the communication network to a plurality of the resource clusters; and a component configured to maintain the coherence of the plurality of resource clusters as further information resources are classified by at least one of: (a) reducing the similarity threshold value for clustering with increasing numbers of the further collected information resources; and (b) selecting a random subset of information resources from the collected information resources; generating a new similarity threshold value for the selected random subset of information resource; and re-clustering the collected information resources using the new similarity threshold value for clustering. 36. The system as claimed in claim 33 , including a parallel cluster search system for evaluating clusters in parallel.