1. A computer implemented method for developing a classifier for classifying electronic communications comprising: querying a user for a phrase that indicates that a communication is not related to a concept; receiving a user identification of the phrase; (a) presenting user-generated electronic communications to a user for labeling as relevant or irrelevant, the electronic communications being selected from groups of electronic communications including: a training set group of electronic communications, the training set group of electronic communications being selected by an active learning algorithm; a system-labeled set of electronic communications previously labeled by the system; a test set group of electronic communications, the test set group of electronic communications for testing the accuracy of a current state of a classifier being developed; a faulty set of electronic communications suspected to be previously mis-labeled by the user; and a random set of electronic communications previously labeled by the user; (b) developing the classifier for classifying electronic communications based upon the phrase, the relevant labels and the irrelevant labels assigned by the user during the presenting of the electronic communications to the user; (c) deploying the classifier for use in classifying electronic communications based upon the relevant labels and the irrelevant labels; and (d) storing a set of electronic communications labeled by the classifier in a memory.