 However, due to the lack of algorithms that scale well with the number of states (or scale to problems with infinite state spaces), simple exploration methods are the most practical.One such method is formula_16-greedy, where formula_17 is a parameter controlling the amount of exploration vs. exploitation.With probability formula_18, exploitation is chosen, and the agent chooses the action that it believes has the best long-term effect (ties between actions are broken uniformly at random).