Oscillating loss in CNN
Oscillating loss can be attributed to either of the following:


Learning rate: Reduce the learning rate so that the gradient descent doesn't overshoot the minima.
Optimizer: Choose ADAM optimizer over the others like SGD. It works well.