1. A method, in a data processing system comprising a processor and a memory, for performing context based synonym filtering for natural language processing, the method comprising: parsing, by the data processing system, content into one or more conceptual units, wherein each conceptual unit comprises a portion of text of the content that is associated with a single concept; for each conceptual unit in the one or more conceptual units, identifying, by the data processing system, a term in the conceptual unit that has a synonym to be utilized during natural language processing of the content; determining, by the data processing system, a first measure of relatedness of the term to at least one other term in the conceptual unit; determining, by the data processing system, a second measure of relatedness of the synonym of the term to the at least one other term in the conceptual unit; determining, by the data processing system, whether or not to utilize the synonym when performing natural language processing on the conceptual unit; and performing, by the data processing system, natural language processing on the content based on results of determining whether or not to utilize the synonym.