Can't train input variable with Keras+Tensorflow
Try explicitly setting the variable as trainable by setting Trainable=True.
Also after the network is created, check if the variable is in the list of
trainables https://www.tensorflow.org/api_docs/python/tf/trainable_variables