text: International Conference on Learning Represen- 
  tations. 
  
  Changmao Li and Jinho D. Choi. 2020. Transform- 
  ers to Learn Hierarchical Contexts in Multiparty 
  Dialogue for Span-based Question Answering. 
  In Proceedings of the 58th Annual Meeting of 
  the Association for Computational Linguistics, 
  pages 5709–5714, Online. Association for Com- 
  putational Linguistics. 
  
  Olga Kovaleva, Alexey Romanov, Anna Rogers, 
  and Anna Rumshisky. 2019. Revealing the Dark 
  Secrets of BERT. In Proceedings of the 2019 
  Conference on Empirical Methods in Natural 
  Language Processing and the 9th International 
  Joint Conference on Natural Language Process- 
  ing (EMNLP-IJCNLP), pages 4356–4365, Hong 
  Kong, China. Association for Computational 
  Linguistics. 
  
  Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, 
  Kurt Keutzer, Dan Klein, and Joseph E Gonzalez. 
  2020. Train large, then compress: Rethinking 
  model size for efﬁcient training and inference of 
  transformers. arXiv preprint arXiv:2002.11794. 