1. A computer-implemented method comprising: generating, by a processing device, a filter for identifying a relevant document based on an initial relevance rule related to a set of documents; applying, by the processing device, the filter to the set of documents thereby identifying a subset of relevant documents; receiving, by the processing device from an assessor, the subset of relevant documents comprising an identification of key information; generating, by the processing device, an updated relevance rule based on the key information and the initial relevance rule, wherein the generating comprises identifying, by the computer, a conflict between the key information and the initial relevance rule, wherein one of the key information and the initial relevance rule identifies at least one document within the set of documents to be relevant and the other of the key information and the initial relevance rule identifies the at least one document within the set of documents to be non-relevant; generating, by the processing device, a query based on the updated relevance rule for identifying the relevant documents within the set of documents; and outputting, by the processing device, the set of documents within which the relevant documents have been identified.