optimal policy is referred to as the Bellman optimality equation: where is the optimal policy and refers to the value function of the optimal policy. The equation above describes the reward for taking the action giving the highest expected return. See also References Equations Dynamic programming Control theory