Alternative Hunspell dictionary for stemming I am using Hunspell to spellcheck and stem the words in my documents to reduct dimensionality. For spellchecking Hunspell works great with the default en_US dictionary by SCOWL (and friends), but not so for stemming.

The reason is that the dictionary is pretty inconsistent. (e.g. some words have their plurals in the dictionary, but some others doesn't, so it's inconsistent if the stem of a word in plural will be in plural or not).

Hunspell is definitely able to stem english words consistently, but it needs an other dictionary that is more "correct" morphologically.


What alternative dictionaries can I use to improve the quality of stemming English text with Hunspell?
If there are no such dictionaries, what other tools can I use for stemming? EDIT: note that I'm using python, which can be hooked up with most libraries and command-line tools easily, but R or Matlab specific tools might not fit in my current ecosystem that well.
I can't comment on your question (my reputation isn't high enough), but I've got a few clarifying questions to ask: Why do you want to stem words?  Text classification?  Sentiment analysis?  Something else?

I've used both the 'tm' package and the 'RTextTools' package for stemming when doing text classification.  Both have some built-in functions for stemming.

Whether they would be useful to you or not depends on why you want to stem words ... 

FWIW, here are some links related to those packages:


tm: https://cran.r-project.org/web/packages/tm/index.html
RTextTools: http://www.rtexttools.com/documentation.html