text: E.3 Sample Efficiency of pretraining 
  
  We compare the sample efficiency of pretraining various state-of-the-art image and video models. Specifically, we 
  look at the number of samples (image or video clips) processed by the network during pretraining, which is larger 
  than the size of the pretraining dataset for multi-epoch training. Notably, our results with V-JEPA are obtained 
  while processing an order of magnitude fewer samples than previous methods, and notably two orders of magnitude 
  fewer samples than OpenCLIP. We believe that further investment towards improving the video pretraining data 
  distribution could lead to substantial gains in downstream image and video tasks. 