Fine-tuning the vision encoder tuned out to be very important in our openvla experiments, so I’d recommend trying LoRA on everything and the “sandwich” top+bottom thing you suggested. We have some LoRA experiments in the openvla paper, but only tested it after robot pretraining