Increase F1 score on a text corpus
Have you tried without the Tf-Idf weighting? What about a bi-gram analysis?

You can also review the pre processing, maybe without removing the low frequency words (wich the tf idf already does). Another idea is to remove one very high frequency word that appear on your corpora.