text: Victor Sanh, Lysandre Debut, Julien Chaumond, 
  and Thomas Wolf. 2019b. DistilBERT, a dis- 
  tilled version of BERT: Smaller, faster, cheaper 
  and lighter. In 5th Workshop on Energy Efﬁcient 
  Machine Learning and Cognitive Computing - 
  NeurIPS 2019. 
  
  Alessandro Raganato, Yves Scherrer, and Jörg 
  Tiedemann. 2020. Fixed Encoder Self-Attention 
  Patterns in Transformer-Based Machine Transla- 
  tion. arXiv:2002.10260 [cs]. 
  Victor Sanh, Thomas Wolf, and Alexander M. 
  Rush. 2020. Movement Pruning: Adaptive Spar- 
  sity by Fine-Tuning. arXiv:2005.07683 [cs]. 
  
  Alessandro Raganato and Jörg Tiedemann. 2018. 
  An Analysis of Encoder Representations in 
  Transformer-Based Machine Translation. In Pro- 
  ceedings of the 2018 EMNLP Workshop Black- 
  boxNLP: Analyzing and Interpreting Neural Net- 
  works for NLP, pages 287–297, Brussels, Bel- 
  gium. Association for Computational Linguis- 
  tics. 