Model Finetuned Language # params Size (Gb) Seq. Len. Emb. dim. License Sentence simbert-base-multilingual-cased No multilingual 1,78e+08 0.71 512 768 Apache-2.0 Nobert-base-multilingual-uncased No multilingual 1,67e+08 0.67 512 768 Apache-2.0 Nocamembert-base No french 1,11e+08 0.44 514 768 MIT Nocamembert-large No french 3,37e+08 1.35 514 1024 MIT Nosentence-camembert-base Yes french 1,11e+08 0.44 128 768 Apache-2.0 Yessentence-camembert-large Yes french 3,37e+08 1.35 514 1024 Apache-2.0 Yessentence-flaubert-base Yes french 1,37e+08 0.55 512 768 Apache-2.0 Yesembed-multilingual-light-v3.0 N/A multilingual N/A N/A 512 384 Closed source N/Aembed-multilingual-v3.0 N/A multilingual N/A N/A 512 1024 Closed source N/Aflaubert-base-cased No french 1,38e+08 0.55 512 768 MIT Noflaubert-base-uncased No french 1,37e+08 0.55 512 768 MIT Noflaubert-large-cased No french 3,73e+08 1.49 512 1024 MIT Nodistilbert-base-25lang-cased No multilingual 1,08e+08 0.43 512 768 Apache-2.0 Nodistilbert-base-en-fr-cased No bilingual 6,86e+07 0.27 512 768 Apache-2.0 Nodistilbert-base-fr-cased No french 6,17e+07 0.25 512 768 Apache-2.0 Nomultilingual-e5-base No multilingual 2,78e+08 1.11 512 768 MIT Yesmultilingual-e5-large No multilingual 5,60e+08 2.24 512 1024 MIT Yesmultilingual-e5-small No multilingual 1,18e+08 0.47 512 384 MIT Yese5-mistral-7b-instruct Yes english-plus 7,11e+09 28.44 32768 4096 MIT Yesudever-bloom-1b1 Yes multilingual 1,07e+09 4.26 2048 1536 bloom-rail-1.0 Yesudever-bloom-560m Yes multilingual 5,59e+08 2.24 2048 1024 bloom-rail-1.0 Yeslaser2 Yes multilingual 4,46e+07 0.18 N/A 1024 BSD License Yesall-MiniLM-L12-v2 Yes english-plus 3,34e+07 0.13 128 384 Apache-2.0 Yesall-MiniLM-L6-v2 Yes english-plus 2,27e+07 0.09 256 384 Apache-2.0 Yesdistiluse-base-multilingual-cased-v2 Yes multilingual 1,35e+08 0.54 128 512 Apache-2.0 YesLaBSE Yes multilingual 4,72e+08 1.89 256 768 Apache-2.0 Yesmulti-qa-MiniLM-L6-cos-v1 Yes english 2,27e+07 0.09 512 384 N/A Yesparaphrase-multilingual-MiniLM-L12-v2 Yes multilingual 1,18e+08 0.47 128 384 Apache-2.0 Yessentence-t5-base Yes multilingual 1,10e+08 0.44 256 768 Apache-2.0 Yessentence-t5-large Yes multilingual 3,36e+08 1.34 256 768 Apache-2.0 Yessentence-t5-xl Yes multilingual 1,24e+09 4.97 256 768 Apache-2.0 Yessentence-t5-xxl Yes multilingual 4,87e+09 19.46 256 768 Apache-2.0 Yestext2vec-base-multilingual Yes multilingual 1,18e+08 0.47 256 384 Apache-2.0 Yestext-embedding-ada-002 N/A multilingual N/A N/A 8191 1536 Closed source N/Atext-embedding-3-small N/A multilingual N/A N/A 8191 1536 Closed source N/Atext-embedding-3-large N/A multilingual N/A N/A 8191 3072 Closed source N/Amistral-embed N/A multilingual N/A N/A 16384 1024 Closed source N/Auniversal-sentence-encoder-multilingual-3 Yes multilingual 6,89e+07 0.28 N/A 512 Apache-2.0 Yesuniversal-sentence-encoder-multilingual-large-3 Yes multilingual 8,52e+07 0.34 N/A 512 Apache-2.0 Yesxlm-roberta-base No multilingual 2,78e+08 1.11 514 768 MIT Noxlm-roberta-large No multilingual 5,60e+08 2.24 514 1024 MIT Nosentence-croissant-llm-base Yes french 1,28e+09 5.12 256 2048 MIT Yesparaphrase-multilingual-mpnet-base-v2 No multilingual 2,78e+08 1.11 128 768 Apache-2.0 Yesvoyage-2 N/A english N/A N/A 4000 1024 Closed source N/Avoyage-code-2 N/A english N/A N/A 16000 1536 Closed source N/ASolon-embeddings-large-0.1 Yes french 5.60e+08 2.239561728 512.0 1024.0 MIT YesSolon-embeddings-base-0.1 Yes french 2.78e+08 1.112174592 512.0 768.0 MIT Yessentence-croissant-alpha-v0.3 Yes french 1.28e+09 5.11954944 1024.0 2048.0 MIT Yessentence-croissant-alpha-v0.2 Yes french 1.28e+09 5.11954944 1024.0 2048.0 MIT Yesbge-m3 Yes multilingual 5.68e+08 2.271019008 8192.0 1024.0 MIT Yesbge-m3-custom-fr Yes multilingual 5.68e+08 2.271019008 8192.0 1024.0 MIT Yes
Table 7: Models included in the benchmark with their main characteristics. The size in Gb is estimated using the
number of parameters counted as float32 numbers. Sentence sim refers to the fact that the model was trained on a