Li Fei-Fei. Imagenet large scale visual recognition chal-
lenge. International Journal of Computer Vision, 115(3):
211–252, 2015.
Chaitanya Ryali, Yuan-Ting Hu, Daniel Bolya, Chen Wei,
Haoqi Fan, Po-Yao Huang, Vaibhav Aggarwal, Arka-
bandhu Chowdhury, Omid Poursaeed, Judy Hoffman, et al.
Hiera: A hierarchical vision transformer without the bells-
and-whistles. arXiv preprint arXiv:2306.00989, 2023.
Laura Sevilla-Lara, Shengxin Zha, Zhicheng Yan, Vedanuj
Goswami, Matt Feiszli, and Lorenzo Torresani. Only time
can tell: Discovering temporal data for temporal modeling.
In Proceedings of the IEEE/CVF winter conference on
applications of computer vision, pages 535–544, 2021.
Elizabeth S Spelke, Peter Vishton, and Claes Von Hofsten.
Object perception, object-directed action, and physical
knowledge in infancy. 1995.
Nitish Srivastava, Elman Mansimov, and Ruslan Salakhudi-
nov. Unsupervised learning of video representations using
lstms. In International conference on machine learning,
pages 843–852. PMLR, 2015.
Chen Sun, Austin Myers, Carl Vondrick, Kevin Murphy, and
Cordelia Schmid. Videobert: A joint model for video and
language representation learning. In Proceedings of the
IEEE/CVF international conference on computer vision,
pages 7464–7473, 2019.
Dídac Surís, Ruoshi Liu, and Carl Vondrick. Learning the pre-
dictability of the future. InProceedings of the IEEE/CVF
Conference on Computer Vision and Pattern Recognition,
pages 12607–12617, 2021.
Reuben Tan, Matthias De Lange, Michael Iuzzolino, Bryan A
Plummer, Kate Saenko, Karl Ridgeway, and Lorenzo Tor-
resani. Multiscale video pretraining for long-term activity
forecasting. arXiv preprint arXiv:2307.12854, 2023.
Antti Tarvainen and Harri Valpola. Mean teachers are bet-
ter role models: Weight-averaged consistency targets im-
prove semi-supervised deep learning results.arXiv preprint
arXiv:1703.01780, 2017.
Yuandong Tian, Xinlei Chen, and Surya Ganguli. Under-
standing self-supervised learning dynamics without con-
trastive pairs. In International Conference on Machine
Learning, pages 10268–10278. PMLR, 2021.
Zhan Tong, Yibing Song, Jue Wang, and Limin Wang. Video-
mae: Masked autoencoders are data-efficient learners for
self-supervised video pre-training. Advances in neural
information processing systems, 35:10078–10093, 2022.
Grant Van Horn, Oisin Mac Aodha, Yang Song, Yin Cui,
Chen Sun, Alex Shepard, Hartwig Adam, Pietro Perona,
and Serge Belongie. The inaturalist species classification
and detection dataset. InProceedings of the IEEE con-
ference on computer vision and pattern recognition, pages
8769–8778, 2018.
Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-
Antoine Manzagol. Extracting and composing robust fea-
tures with denoising autoencoders. InProceedings of the
25th International Conference on Machine Learning, ICML
’08, page 1096–1103, 2008.
Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Ben-
gio, Pierre-Antoine Manzagol, and Léon Bottou. Stacked
denoising autoencoders: Learning useful representations
in a deep network with a local denoising criterion.Journal
of machine learning research, 11(12), 2010.
Carl Vondrick, Hamed Pirsiavash, and Antonio Torralba.
Anticipating visual representations from unlabeled video.
In Proceedings of the IEEE conference on computer vision
and pattern recognition, pages 98–106, 2016.
Fei Wang, Ping Li, and Arnd Christian Konig. Learning
a bi-stochastic data similarity matrix. In 2010 IEEE
International Conference on Data Mining, pages 551–560.
IEEE, 2010.
Limin Wang, Bingkun Huang, Zhiyu Zhao, Zhan Tong, Yinan
He, Yi Wang, Yali Wang, and Yu Qiao. Videomae v2:
Scaling video masked autoencoders with dual masking. In
Proceedings of the IEEE/CVF Conference on Computer
Vision and Pattern Recognition, pages 14549–14560, 2023a.
Rui Wang, Dongdong Chen, Zuxuan Wu, Yinpeng Chen,
Xiyang Dai, Mengchen Liu, Lu Yuan, and Yu-Gang Jiang.
Masked video distillation: Rethinking masked feature mod-