Model ranking
Finetuned vs pretrained
Model number of parameters
Max sequence length
Embedding dimension
T uned for sentence similarity
Bilingual
English
English +
tuning on
other languages
French
Multilingual
Closed source
Model ranking
Finetuned vs pretrained
Model number of parameters
Max sequence length
Embedding dimension
T uned for sentence similarity
Bilingual
English
English +
tuning on
other languages
French
Multilingual
Closed source
 0.6
0.4
0.2
0.0
0.2
0.4
0.6
0.8
1.0
Figure 10: Heatmap representing cross-correlations between models’ characteristics and models’ performances.
17