text: Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. 
  Weld, Luke Zettlemoyer, and Omer Levy. 2020. 
  SpanBERT: Improving Pre-Training by Repre- 
  senting and Predicting Spans. Transactions of 
  the Association for Computational Linguistics, 
  8:64–77. 
  
  Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzeb- 
  ski, Bruna Morrone, Quentin de Laroussilhe, An- 
  drea Gesmundo, Mona Attariyan, and Sylvain 
  Gelly. 2019. Parameter-Efﬁcient Transfer Learn- 
  ing for NLP. arXiv:1902.00751 [cs, stat]. 
  
  Wei-Tsung Kao, Tsung-Han Wu, Po-Han Chi, 
  Chun-Cheng Hsieh, and Hung-Yi Lee. 2020. 
  Further boosting BERT-based models by du- 
  Some intriguing 
  plicating existing layers: 
  arXiv preprint 
  phenomena inside BERT. 
  arXiv:2001.09309. 
  
  Phu Mon Htut, Jason Phang, Shikha Bordia, and 
  Samuel R Bowman. 2019. Do attention heads 
  in BERT track syntactic dependencies? arXiv 
  preprint arXiv:1911.12246. 