GPU Render slows when computer is inactive
I think that as you are using GPU rendering after a while as the image is still roughly the same on your screen, the GPU hibernates/ power saves as it is not being used. That is probably why when you browse the internet it goes back to normal.

I would recommend CPU rendering unless your GPU is O.P. compared to your CPU which i don't think it is.