text: Microsoft. 2020.  Turing-NLG: A 17-billion- 
  
  parameter language model by microsoft. 
  
  Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. 
  Corrado, and Jeff Dean. 2013. Distributed repre- 
  sentations of words and phrases and their compo- 
  sitionality. In Advances in Neural Information 
  Processing Systems 26 (NIPS 2013), pages 3111– 
  3119. 
  
  Tiago Pimentel, Josef Valvoda, Rowan Hall Maud- 
  slay, Ran Zmigrod, Adina Williams, and Ryan 
  Cotterell. 2020. Information-Theoretic Probing 
  for Linguistic Structure. arXiv:2004.03061 [cs]. 
  
  Nina Poerner, Ulli Waltinger, and Hinrich Schütze. 
  2019. 
  BERT is not a knowledge base 
  (yet): Factual knowledge vs. name-based rea- 
  arXiv preprint 
  soning in unsupervised qa. 
  arXiv:1911.03681.  Jiaqi Mu and Pramod Viswanath. 2018. All-but- 
  the-top: Simple and effective postprocessing for 
  word representations. In International Confer- 
  ence on Learning Representations. 