Model confusing classes
One option is to print the confusion matrix to see the rate of misclassification by class. 

Another option is to read through the misclassified documents to see if a pattern is apparent.