text: Pre-Training for Deep Language Understanding. 
  arXiv:1908.04577 [cs]. 
  
  Thomas Wolf, Lysandre Debut, Victor Sanh, Julien 
  Chaumond, Clement Delangue, Anthony Moi, 
  Pierric Cistac, Tim Rault, Rémi Louf, Morgan 
  Funtowicz, and Jamie Brew. 2020. Hugging- 
  Face’s Transformers: State-of-the-Art Natural 
  Language Processing. arXiv:1910.03771 [cs]. 
  
  Wenhui Wang, Furu Wei, Li Dong, Hangbo 
  Bao, Nan Yang, and Ming Zhou. 2020b. 
  MiniLM: Deep Self-Attention Distillation for 
  Task-Agnostic Compression of Pre-Trained 
  Transformers. arXiv preprint arXiv:2002.10957. 
  
  Felix Wu, Angela Fan, Alexei Baevski, Yann 
  Dauphin, and Michael Auli. 2019a. Pay Less At- 
  tention with Lightweight and Dynamic Convolu- 
  tions. In International Conference on Learning 
  Representations. 
  
  Xiaozhi Wang, Tianyu Gao, Zhaocheng Zhu, 
  Zhiyuan Liu, Juanzi Li, and Jian Tang. 2020c. 
  KEPLER: A Uniﬁed Model for Knowledge Em- 
  bedding and Pre-trained Language Representa- 
  tion. arXiv:1911.06136 [cs]. 