3. A computer implemented method for developing a classifier for classifying electronic communications comprising: querying a user for a phrase that indicates that a communication is not related to a concept; receiving a user identification of the phrase; (a) presenting electronic communications to a user for labeling as relevant or irrelevant, the electronic communications being selected from groups of user-generated electronic communications including: a training set group of electronic communications, the training set group of electronic communications being selected by an active learning algorithm; a test set group of electronic communications, the test set group of electronic communications for testing the accuracy of a current state of a classifier being developed; and a previously-labeled set of electronic communications previously labeled by at least one of the user, the system and another user; (b) developing the classifier for classifying electronic communications based upon the phrase and the relevant labels and the irrelevant labels assigned by the user; (c) deploying the classifier for use in classifying electronic communications based upon the relevant labels and the irrelevant labels; and (d) storing a set of electronic communications labeled by the classifier in a memory.
3. A computer implemented method for developing a classifier for classifying electronic communications comprising: querying a user for a phrase that indicates that a communication is not related to a concept; receiving a user identification of the phrase; (a) presenting electronic communications to a user for labeling as relevant or irrelevant, the electronic communications being selected from groups of user-generated electronic communications including: a training set group of electronic communications, the training set group of electronic communications being selected by an active learning algorithm; a test set group of electronic communications, the test set group of electronic communications for testing the accuracy of a current state of a classifier being developed; and a previously-labeled set of electronic communications previously labeled by at least one of the user, the system and another user; (b) developing the classifier for classifying electronic communications based upon the phrase and the relevant labels and the irrelevant labels assigned by the user; (c) deploying the classifier for use in classifying electronic communications based upon the relevant labels and the irrelevant labels; and (d) storing a set of electronic communications labeled by the classifier in a memory. 8. The method of claim 3 wherein presenting the electronic communications to the user includes: assessing a first value that labeling a first set of electronic communications from a first one of the training set group, the system-labeled set, the test set group, the faulty set, or the random set will provide to the classifier being developed; assessing a second value related to performance that labeling a second set of electronic communications from a second one of the training set group, the system-labeled set, the test set group, the faulty set, or the random set provides to the classifier being developed; and selecting a next group for labeling based upon the greatest of the first value and the second value that will be provided to the classifier being developed from the assessing.