For a Markov decision process, what that specifically means is that the probability distribution over your outcomes depends only on the current state and action, not on the whole history of how you got there. 