text: Table 2 Pretraining Data Distribution. We pretrain all models for 90K iterations using a batch size of 3072, and evaluate 
  downstream performance of the frozen backbones with an attentive probe using a single center view. Average performance 
  across tasks increases with the pretraining dataset size. 