title: What does Tensorflow LSTM return?
body: <p>I'm writing a German-&gt;English translator using an encoder/decoder pattern, where the encoder connects to the decoder by passing the state output of its last LSTM layer
  as the input state of the decoder's LSTM.</p>
  <p>I'm stuck, though, because I don't know how to interpret the output of the encoder's LSTM.  A small example:</p>
  <pre><code>tensor = tf.random.normal( shape = [ 2, 2, 2 ])
  lstm = tf.keras.layers.LSTM(units=4, return_sequences=True, return_state=True )
  result = lstm( ( tensor )
  print( &quot;result:\n&quot;, result )
  </code></pre>
  <p>Executing this in Tensorflow 2.0.0 produces:</p>
  <pre><code>result:
  [
  &lt;tf.Tensor: id=6423, shape=(2, 2, 3), dtype=float32, numpy=
  array([[[ 0.05060377, -0.00500009, -0.10052835],
          [ 0.01804499,  0.0022153 ,  0.01820258]],
         [[ 0.00813384, -0.08705016,  0.06510869],
          [-0.00241707, -0.05084776,  0.08321179]]], dtype=float32)&gt;,
  &lt;tf.Tensor: id=6410, shape=(2, 3), dtype=float32, numpy=
  array([[ 0.01804499,  0.0022153 ,  0.01820258],
         [-0.00241707, -0.05084776,  0.08321179]], dtype=float32)&gt;,
  &lt;tf.Tensor: id=6407, shape=(2, 3), dtype=float32, numpy=
  array([[ 0.04316794,  0.00382055,  0.04829971],
         [-0.00499733, -0.10105743,  0.1755833 ]], dtype=float32)&gt;
  ]
  </code></pre>
  <p>The result is a list of three tensors.  The first appears to be the output of all
  hidden states, as selected by <code>return_sequences=True</code>.  My question is:  <strong>What is the interpretation of the second and third Tensors in</strong> <code>result</code>?</p>