Rui Wang, Dongdong Chen, Zuxuan Wu, Yinpeng Chen,
Xiyang Dai, Mengchen Liu, Lu Yuan, and Yu-Gang Jiang.
Masked video distillation: Rethinking masked feature mod-
eling for self-supervised video representation learning. In
Proceedings of the IEEE/CVF Conference on Computer
Vision and Pattern Recognition, pages 6312–6322, 2023b.
YiWang, KunchangLi, YizhuoLi, YinanHe, BingkunHuang,
Zhiyu Zhao, Hongjie Zhang, Jilan Xu, Yi Liu, Zun Wang,
et al. Internvideo: General video foundation models via
generative and discriminative learning. arXiv preprint
arXiv:2212.03191, 2022.
Laurenz Wiskott and Terrence J Sejnowski. Slow feature
analysis: Unsupervised learning of invariances. Neural
computation, 14(4):715–770, 2002.
Zhirong Wu, Yuanjun Xiong, Stella X Yu, and Dahua Lin.
Unsupervised feature learning via non-parametric instance
discrimination. In Proceedings of the IEEE conference on
computer vision and pattern recognition, pages 3733–3742,
2018.
Zhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin, Jianmin
Bao, Zhuliang Yao, Qi Dai, and Han Hu. Simmim: A sim-
ple framework for masked image modeling.arXiv preprint
arXiv:2111.09886, 2021.
Dejing Xu, Jun Xiao, Zhou Zhao, Jian Shao, Di Xie, and
Yueting Zhuang. Self-supervised spatiotemporal learn-
ing via video clip order prediction. InProceedings of the
IEEE/CVF Conference on Computer Vision and Pattern
Recognition, pages 10334–10343, 2019.
Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko,
Armen Aghajanyan, Florian Metze, Luke Zettlemoyer,
and Christoph Feichtenhofer. Videoclip: Contrastive pre-
training for zero-shot video-text understanding. arXiv
preprint arXiv:2109.14084, 2021.
Jiahui Yu, Zirui Wang, Vijay Vasudevan, Legg Yeung, Mo-
jtaba Seyedhosseini, and Yonghui Wu. Coca: Contrastive
captioners are image-text foundation models. arXiv
preprint arXiv:2205.01917, 2022.
13