With BERT, two fully unsupervised tasks are performed. The Masked Language Model and the Next Sentence Prediction (NSP).

For this study, the NSP is used as a proxy for the relevance of response. 
 Question: was bert used?
Yes