How to deal with situation where LSTM fails to learn (constantly makes the same incorrect prediction)
Try using a recurrent neural network and use a RProp minus trainer without weight backtracking (aka RProp-, cf. [Igel&amp;Huesken, Neurocomputing 50, 2003]) and without ponderation, ie. all training samples have the same weight.