How to implement an Automatic Learning Rate for a Neural Network?
Adjusting for learning rate is a common scenario in machine learning. There is rich literature about it, countless papers. The most common implementation:


AdaGrad
RMSProp
Adam


There are many more variants. You'll need to do some research. Please take a look at:


  https://en.wikipedia.org/wiki/Stochastic_gradient_descent