-ep average best -ep average average (episode - you now have your first non-trivial bot for gamesbut let' put this average reward of into perspective according to the gym frozenlake page"solvingthe game means attaining -episode average of informally"solvingmeans "plays the game very wellwhile not in record timethe -table agent is able to solve frozenlake in episodes howeverthe game may be more complex hereyou used table to store all of the possible statesbut consider tic tac toe in which there are , possible states likewiseconsider space invaders where there are too many possible states to count -table is not sustainable as games grow increasingly complex for this reasonyou need some way to approximate the -table as you continue experimenting in the next stepyou will design function that can accept states and actions as inputs and output -value step -building deep -learning agent for frozen lake in reinforcement learningthe neural network effectively predicts the value of based on the state and action inputsusing table to store all the possible valuesbut this becomes unstable in complex games deep reinforcement learning instead uses neural network to approximate the -function for more detailssee understanding deep -learning to get accustomed to tensorflowa deep learning library you installed in step you will reimplement all of the logic used so far with