recurrent neural networks weights are associated with the hidden state while computing the output this is denoted by there is also bias termdenoted by the tanh activation function is used in the computation of the hidden state the softmax activation function is used in the computation of the output let' now consider variation of the rnn where only single output is produced for the entire sequence (figure - such an rnn is described using the following equationsth(tanh uxt yt - ysoftmax vh( figure - rnn (producing single output for the entire input sequence