Can accuracy become worse on the training set with more epochs?
Yes, accuracy measured on the training set over epochs is not monotonically decreasing.

Possible reasons:


Software bug
Nan due to division by zero / log (0) / overflow
Too big learning rate