recurrent neural networks figure - bidirectional rnn vanishing and exploding gradients training rnns can be challenging due to vanishing and exploding gradients (figure - vanishing gradients means that when the gradients are computed on the unrolled rnnsthe value of the gradients can drop to very small number (close to zerosimilarlythe gradients can increase to very high valuewhich is referred to as the exploding gradient problem in both casestraining the rnn is challenge vanishing or exploding gradients are usually result of the inappropriate or undesired values set for the network hyperparameters and parameters thereforethe network takes an unusually long time to move out of the slope with each incremental weight updates and learn the best weights for the use case