equationan equation widely used in machine learning to find the optimal policy within given environment the bellman equation incorporates two ideas that are highly relevant to this project firsttaking particular action from particular state many times will result in good estimate for the -value associated with that state and action to this endyou will increase the number of episodes this bot must play through in order to return stronger -value estimate secondrewards must propagate through timeso that the original action is assigned non-zero reward this idea is clearest in games with delayed rewardsfor examplein space invadersthe player is rewarded when the alien is blown up and not when the player shoots howeverthe player shooting is the true impetus for reward likewisethe -function must assign (state shoota positive reward firstupdate num_episodes to equal /ataribot/bot_ _q_table py np random seed( num_episodes thenadd the necessary hyperparameters to the top of the file in the form of two more variables/ataribot/bot_ _q_table py