15. An apparatus comprising: a processor, and a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to: receive, by a natural language processing pipeline configured to execute in the data processing system, an input document to be ingested into a corpus; divide, by the natural language processing pipeline, the input document into a plurality of input passages; identify, by a filter component of the natural language processing pipeline, whether each input passage is a nonsense passage based on a value of a metric determined according to a set of feature counts, wherein identifying whether a given input passage is a nonsense passage comprises: annotating, by an annotator in the natural language processing pipeline, the given input passage within the plurality of input passages with linguistic features to form an annotated passage; counting, by metric counters component in the natural language processing pipeline, a number of instances of each type of linguistic feature in the annotated passage to form a set of feature counts; determining, by the metric counters component of the natural language processing pipeline, a value for a metric based on the set of feature counts; and comparing, by a comparator component of the natural language processing pipeline, the value for the metric to a predetermined model threshold; filter, by the natural language processing pipeline, each input passage in the plurality of input passages based on whether the input passage is identified as a nonsense passage or not identified as a nonsense passage to form a filtered plurality of input passages; and add, by the natural language processing pipeline, the filtered plurality of input passages into the corpus.
15. An apparatus comprising: a processor, and a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to: receive, by a natural language processing pipeline configured to execute in the data processing system, an input document to be ingested into a corpus; divide, by the natural language processing pipeline, the input document into a plurality of input passages; identify, by a filter component of the natural language processing pipeline, whether each input passage is a nonsense passage based on a value of a metric determined according to a set of feature counts, wherein identifying whether a given input passage is a nonsense passage comprises: annotating, by an annotator in the natural language processing pipeline, the given input passage within the plurality of input passages with linguistic features to form an annotated passage; counting, by metric counters component in the natural language processing pipeline, a number of instances of each type of linguistic feature in the annotated passage to form a set of feature counts; determining, by the metric counters component of the natural language processing pipeline, a value for a metric based on the set of feature counts; and comparing, by a comparator component of the natural language processing pipeline, the value for the metric to a predetermined model threshold; filter, by the natural language processing pipeline, each input passage in the plurality of input passages based on whether the input passage is identified as a nonsense passage or not identified as a nonsense passage to form a filtered plurality of input passages; and add, by the natural language processing pipeline, the filtered plurality of input passages into the corpus. 16. The apparatus of claim 15 , wherein filtering each input passage comprises removing a given input passage responsive to the given input passage being identified as a nonsense passage.