text: Soﬁa Serrano and Noah A. Smith. 2019. Is Atten- 
  tion Interpretable? arXiv:1906.03731 [cs]. 
  
  Yu Sun, Shuohuan Wang, Yukun Li, Shikun 
  Feng, Hao Tian, Hua Wu, and Haifeng Wang. 
  2019c. 
  ERNIE 2.0: A Continual Pre- 
  Training Framework for Language Understand- 
  ing. arXiv:1907.12412 [cs]. 
  
  Sheng Shen, Zhen Dong, Jiayu Ye, Linjian Ma, 
  Zhewei Yao, Amir Gholami, Michael W Ma- 
  honey, and Kurt Keutzer. 2019. Q-BERT: Hes- 
  sian Based Ultra Low Precision Quantization of 
  BERT. arXiv preprint arXiv:1909.05840. 
  
  Zhiqing Sun, Hongkun Yu, Xiaodan Song, Ren- 
  jie Liu, Yiming Yang, and Denny Zhou. 2020. 
  MobileBERT: Task-Agnostic Compression of 
  BERT for Resource Limited Devices. 
  
  Chenglei Si, Shuohang Wang, Min-Yen Kan, and 
  Jing Jiang. 2019a. What does BERT learn 
  from multiple-choice reading comprehension 
  datasets? arXiv preprint arXiv:1910.12391. 