Since the total of transition probability from a state i to all other states must be 1, this matrix is a right stochastic matrix, so that .
The product of two right stochastic matrices is also right stochastic.