text: Yada Pruksachatkun, Jason Phang, Haokun Liu, 
  Phu Mon Htut, Xiaoyi Zhang, Richard Yuanzhe 
  Pang, Clara Vania, Katharina Kann, and 
  Samuel R. Bowman. 2020. Intermediate-Task 
  Transfer Learning with Pretrained Language 
  Models: When and Why Does It Work? In Pro- 
  ceedings of the 58th Annual Meeting of the As- 
  sociation for Computational Linguistics, pages 
  5231–5247, Online. Association for Computa- 
  tional Linguistics. 
  
  Anna Rogers, Olga Kovaleva, Matthew Downey, 
  and Anna Rumshisky. 2020. Getting Closer to 
  AI Complete Question Answering: A Set of Pre- 
  requisite Real Tasks. In AAAI, page 11. 
  
  Rudolf Rosa and David Mareˇcek. 2019. 
  
  Induc- 
  ing syntactic trees from BERT representations. 
  arXiv preprint arXiv:1906.11511. 
  
  Victor Sanh, Lysandre Debut, Julien Chaumond, 
  and Thomas Wolf. 2019a. Distilbert, a distilled 
  version of BERT: smaller, faster, cheaper and 
  lighter. arXiv preprint arXiv:1910.01108. 
  
  Colin Raffel, Noam Shazeer, Adam Roberts, 
  Katherine Lee, Sharan Narang, Michael Matena, 
  and Peter J. Liu. 
  Yanqi Zhou, Wei Li, 
  2019. Exploring the Limits of Transfer Learn- 
  ing with a Uniﬁed Text-to-Text Transformer. 
  arXiv:1910.10683 [cs, stat]. 