Furthermore, the basic seq2seq assumes a strict order between generated tokens, but in reality, we should not severely punish the model when it predicts the correct tokens in the wrong order. 
 Question: Do they impose any grammatical constraints over the generated output?
No