We have training and testing sets in three different languages: English, Chinese and Korean. When fine-tuning, we simply adopted the official training script of BERT, with default hyperparameters, to fine-tune each model until training loss converged. 
 Question: what does the model learn in zero-shot setting?
we simply adopted the official training script of BERT, with default hyperparameters, to fine-tune each model until training loss converged