5fa1a76
1
Other vision models, like BeIT and ViTMAE, drew inspiration from BERT's pretraining objective.