10. A system for processing documents, comprising: one or more processors; memory; and one or more modules, wherein the modules are stored within memory and configured to be executed by the one or more processors, the one or more modules including instructions to: group a set of documents into a plurality of clusters, the set of documents comprising a sequence of tokens, wherein each cluster includes one or more documents in the set of documents; generate a compressed representation of the set of documents from which respective documents in the set can be reconstructed, including instructions to generate, for the plurality of clusters, a compressed sequence of tokens by eliding duplicate sequences of tokens within respective clusters; and generate an index of the compressed sequence of tokens, including instructions to index each respective token in the compressed sequence of tokens based on a respective token position of the respective token in the compressed sequence.
10. A system for processing documents, comprising: one or more processors; memory; and one or more modules, wherein the modules are stored within memory and configured to be executed by the one or more processors, the one or more modules including instructions to: group a set of documents into a plurality of clusters, the set of documents comprising a sequence of tokens, wherein each cluster includes one or more documents in the set of documents; generate a compressed representation of the set of documents from which respective documents in the set can be reconstructed, including instructions to generate, for the plurality of clusters, a compressed sequence of tokens by eliding duplicate sequences of tokens within respective clusters; and generate an index of the compressed sequence of tokens, including instructions to index each respective token in the compressed sequence of tokens based on a respective token position of the respective token in the compressed sequence. 12. The system of claim 10 , wherein generating the compressed sequence of tokens comprises: encoding each cluster of documents into a respective cluster sequence of tokens, each cluster sequence of tokens including a set of document reconstruction data for reconstructing documents in the corresponding cluster; and concatenating the respective cluster sequences of tokens into the compressed sequence of tokens.