26. A system comprising: one or more computers, the one or more computers implementing: a dataset tool to identify a comparison vector x having processed features and non-processed features, a first set of vectors, each vector in the first set of vectors having processed features and non-processed features corresponding to the processed features and non-processed features of the comparison vector x, and a candidate vector y from the first set of vectors; and a similarity tool to determine a similarity threshold, and a maximum similarity between the non-processed features of x and the non-processed features of y; wherein the dataset tool removes the vector y from the first set of vectors if the maximum similarity does not meet the similarity threshold.
26. A system comprising: one or more computers, the one or more computers implementing: a dataset tool to identify a comparison vector x having processed features and non-processed features, a first set of vectors, each vector in the first set of vectors having processed features and non-processed features corresponding to the processed features and non-processed features of the comparison vector x, and a candidate vector y from the first set of vectors; and a similarity tool to determine a similarity threshold, and a maximum similarity between the non-processed features of x and the non-processed features of y; wherein the dataset tool removes the vector y from the first set of vectors if the maximum similarity does not meet the similarity threshold. 95. The system of claim 26 , in which the similarity tool stores the maximum similarity; and accumulates the partial similarity scores to determine an accumulated partial similarity score, each partial similarity score being a similarity between processed features of the comparison vector x and corresponding processed features of vectors in the first set of vectors; and the dataset tool identifies pairs of similar vectors based on the respective accumulated partial similarity scores.