Is there HMM that looks two elements back? The original HMM model looks only one element back (considers only previous state). Sometimes it viable to look two elements back. Is there an extension to HMM that allows that?
I think the keyword you are looking for is Higher Order Hidden Markov Models. Your "ordinary" HMM would be considered a First Order HMM. So yes, there is literature these types of HMMs.