Finally, the decoder task, which predicts the target sequence probability at time INLINEFORM3 based on previous output and context information INLINEFORM4 , can be formulated as: DISPLAYFORM0 
 Question: How does their decoder generate text?
decoder task, which predicts the target sequence probability at time INLINEFORM3 based on previous output and context information