But if they do, then one of those assumptions have to violated, either states aren't finite, that's sort of hard one to disagree with, so it must be that either we can't get from  someplace to every place else, or that those transition probabilities can change. 