text: D.3 Finetuning 
  
  Following Tong et al. (2022), we finetune a linear layer on top of our model, using a layer decay schema and mixup 
  as the data augmentation pipeline. We provide all hyper-parameters for both K400 and SSv2 in Table 11. 