1. A computer program product comprising a non-transitory computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to: receive a set of documents to be added to a corpus of documents; record document characteristics of each document within the set of documents using a characteristic recording annotator executing within the computing device; predict an ingestion time for each document within the set of documents based on the document characteristics and a machine learning model, wherein the ingestion time is a predicted time to ingest each given document by a plurality of annotators executing within the computing device; determining, for a given document, a document characteristic, wherein the document characteristic corresponds to a corresponding annotator used to process the document characteristic during ingestion; and assign the set of documents to question answering system resources to be processed based on the predicted ingestion time for each document, wherein assigning the set of documents to the question answering system resources comprises disabling or delaying execution of the corresponding annotator during ingestion of the given document.
3. The computer program product of claim 1 , wherein the computer readable program further causes the computing device to: receive a set of input documents; record document characteristics of each input document within the set of input documents using the characteristic recording annotator; ingest each input document within the set of input documents using a pipeline of annotators within the computing device, wherein each annotator within the pipeline of annotators processes a portion of the input document for a respective document characteristic; record a processing time of each annotator within the pipeline of annotators; and generate the machine learning model based on the recorded document characteristics and the recorded processing times.