Specifically, we design three tasks for seq2seq model pre-training, namely Sentence Reordering (SR), Next Sentence Generation (NSG), and Masked Document Generation (MDG).  
 Question: What is masked document generation?
A task for seq2seq model pra-training that recovers a masked document to its original form.