As can be seen, there is a rapid initial drop in energy in the first few episodes, which serve to quickly correct the initial guess. As later episodes explore the determinant space, the agent continues to decrease the energy and refine the set of determinants. Larger external determinant spaces may provide faster convergence with respect to episode, but the larger set of candidate actions results in longer episodes, which may explain this behavior. If the external determinant space is too small, the agent may end up in a higher energy local minima, as may be the case in Fig. for the |S 2 | = 50 case after episode 28. In most cases, minimal energetic refinement is obtained after 30 episodes, though for larger systems it may be necessary to consider additional episodes.