figure - basic structure of rnn and lstm units (sourcechristopher olah' blogcolah github iothe rnn units usually have chain of repeating modules (this happens when we unroll the looprefer to figure - in where we talk about thissuch that the module has simple structure of having maybe one layer with the tanh activation lstms are also special type of rnnhaving similar structure but the lstm unit has four neural network layers instead of just one the detailed architecture of the lstm cell is shown in figure -