Our model contains five independent decoders, one for each image in the sequence. This allows each decoder to learn a specific language model for each position of the sequence. 
 Question: Do the decoder LSTMs all have the same weights?
No