 A unigram model can be treated as the combination of several one-state finite automata.It splits the probabilities of different terms in a context, e.g.from 

to 

In this model, the probability of each word only depends on that word's own probability in the document, so we only have one-state finite automata as units.