text: Jonathan Frankle and Michael Carbin. 2019. The 
  Lottery Ticket Hypothesis: Finding Sparse, 
  In International 
  Trainable Neural Networks. 
  Conference on Learning Representations. 
  
  Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pa- 
  supat, and Ming-Wei Chang. 2020. REALM: 
  Retrieval-Augmented Language Model Pre- 
  Training. arXiv:2002.08909 [cs]. 
  
  Prakhar Ganesh, Yao Chen, Xin Lou, Moham- 
  mad Ali Khan, Yin Yang, Deming Chen, Mari- 
  anne Winslett, Hassan Sajjad, and Preslav Nakov. 
  2020. Compressing large-scale transformer- 
  based models: A case study on BERT. arXiv 
  preprint arXiv:2002.11985. 
  
  Yaru Hao, Li Dong, Furu Wei, and Ke Xu. 2019. 
  Visualizing and Understanding the Effective- 
  In Proceedings of the 2019 
  ness of BERT. 
  Conference on Empirical Methods in Natural 
  Language Processing and the 9th International 
  Joint Conference on Natural Language Process- 
  ing (EMNLP-IJCNLP), pages 4143–4152, Hong 