Markov assumption is always going to be an approximation but the question is how good of that approximation and if we add, for example, V of t, which is the velocity times t, maybe the exploration of time t, maybe the robot's intent, where its goal is. 