 The "action-value function" of such an optimal policy (formula_61) is called the "optimal action-value function" and is commonly denoted by formula_62.In summary, the knowledge of the optimal action-value function alone suffices to know how to act optimally.Assuming full knowledge of the MDP, the two basic approaches to compute the optimal action-value function are value iteration and policy iteration.