text: arXiv preprint 
  
  On Reading-comprehension. 
  arXiv:1912.06638. 
  
  Elena Voita, Rico Sennrich, and Ivan Titov. 2019a. 
  The Bottom-up Evolution of Representations in 
  the Transformer: A Study with Machine Transla- 
  tion and Language Modeling Objectives. In Pro- 
  ceedings of the 2019 Conference on Empirical 
  Methods in Natural Language Processing and 
  the 9th International Joint Conference on Nat- 
  ural Language Processing (EMNLP-IJCNLP), 
  pages 4387–4397. 
  Shubham Toshniwal, Haoyue Shi, Bowen Shi, 
  Lingyu Gao, Karen Livescu, and Kevin Gim- 
  pel. 2020. A Cross-Task Analysis of Text Span 
  Representations. In Proceedings of the 5th Work- 
  shop on Representation Learning for NLP, pages 
  166–176, Online. Association for Computational 
  Linguistics. 
  
  Elena Voita, David Talbot, Fedor Moiseev, Rico 
  Sennrich, and Ivan Titov. 2019b. Analyzing 
  Multi-Head Self-Attention: Specialized Heads 
  Do the Heavy Lifting, the Rest Can Be Pruned. 
  arXiv preprint arXiv:1905.09418. 