In mathematics , a Markov chain , named after Andrey Markov , is a discrete random process with the Markov property . A discrete random process means a system which can be in various states . Formally , a Markov chain is a discrete ( discrete-time ) random process with the Markov property .