Possible to use different learning rate for different neuron in Keras/Tensorflow?
You can follow this thread here: https://github.com/fchollet/keras/pull/3004 Seems at least that the layer-wise tuning should come.