sentence1: devlin et al proposed another contextualized word embedding named bert by extending the context to both directions and training on the masked language modelling task .
sentence2: devlin et al further extended language model pre-training by introducing a slot-filling objective to jointly train a bidirectional language model .