The utterance is concatenated with a special symbol marking the end of the sequence. We initialize our word embeddings using 300-dimensional GloVe BIBREF30 and then fine-tune them during training. 
 Question: Do they use pretrained word vectors for dialogue context embedding?
Yes