DQN not learning and step not stepping towards target
In my experience, neural networks with convolutional layers take much much longer to train, so try increasing the number of iterations (time steps). After running, save the network model (I dont know how to do it in torch, but in tensorflow it was model.save(&quot;filename&quot;+&quot;.h5&quot;) ).
Then, load this saved model file and do a test run to see if it worked. In this case, you should notice pretty easily if it learned or not).