Training problem with deep neural network model I am using TensorFlow's Adam optimizer and ReLu activation. But each time I train my model the cost becomes stagnant after some epochs. Can any one help me out with the possible reasons
I have added an image of the cost:
The learning rate is 0.001, the 1st 2 columns are the training data for input neurons and the 3rd column is the training data for output neurons, the nn has two input neurons, two hidden layers with 3 neurons each and one output neuron
Without seeing your code and/or data, it's going to be difficult to give a concrete answer.

Possibly reasons might include:


Your model isn't complex enough to fit the patterns in the data, and so it reaches a local minimum in the error function.
The patterns in the data are not self-consistent, and so this is actually the global minimum in the error function.
There's something wrong with your learning rate parameter, or with the gradient in the problem. Try increasing the learning rate, and ensure your model is being initialized with random weights.