Convergence of Markov model
This isn't a hidden Markov model; this is an ordinary Markov model.  Take a look at Wikipedia's article on Markov chains and specifically the notion of a steady-state distribution (or stationary distribution), or read about the subject in your favorite textbook -- there are many that cover Markov chains.