title: What does "word count" refer to when calculating unigram probabilities in an unigram language model?
body: <p>I'm using an unigram language model. I want to calculate the probability of each unigram. Should I divide the number of occurrences of an unigram with the number of distinct unigrams, or by the count of all unigrams?</p>