1. An automated method, comprising: clustering documents into a first subset and a second subset, where documents in the first subset are duplicative, and where documents in the second subset are duplicative to one another and differ from the documents in the first subset; selecting a first representative document and a second representative document, where the first representative document is selected from the first subset, and where the second representative document is selected from the second subset; determining a first redirect target document and a second redirect target document, where the first redirect target document is referenced by the first representative document, and where the second redirect target document is referenced by the second representative document; determining that the first redirect target document and the second redirect target document are duplicative; re-clustering the documents in response to determining that the first redirect target and the second redirect target are duplicative, where re-clustering the documents include combining the first subset and the second subset; and indexing, based on a document included in the combined first and second subsets, the combined first and second subsets.