Why isn't the loss of my neural network reduced after 2500 iterations? I have developed a basic feedforward neural network from scratch to classify whether image is of cat or not cat. It works fine, but after 2500 iterations, my cost function is not reducing properly.
The loss function which I am using is
$L(\hat{y},y) = -ylog\hat{y}-(1-y)log(1-\hat{y})$
Can you please point out where I am going wrong the link to the notebook is
https://www.kaggle.com/sidcodegladiator/catnoncat-nn?
You may try to adjust the learning rate first. As the learning rate has a great effect on changing the weights and the bias value.
See if the results has changed after adjusting the learning rate.