SyntecReranking
AlloprofReranking
SyntecRetrieval
BSARDRetrieval
AlloprofRetrieval
Reranking Retrieval
bge-m3 0.88 0.74 0.85 0.60 0.49
distilbert-base-25lang-cased 0.39 0.29 0.18 0.11 0.01
distilbert-base-en-fr-cased 0.39 0.29 0.18 0.11 0.01
distilbert-base-fr-cased 0.39 0.29 0.18 0.11 0.01
sentence-camembert-large 0.82 0.63 0.79 0.56 0.33
sentence-flaubert-base 0.81 0.48 0.69 0.42 0.18
Solon-embeddings-base-0.1 0.85 0.71 0.81 0.00 0.41
Solon-embeddings-large-0.1 0.87 0.72 0.85 0.58 0.47
sentence-croissant-llm-base 0.78 0.57 0.74 0.52 0.30
bert-base-multilingual-cased 0.43 0.32 0.19 0.10 0.02
bert-base-multilingual-uncased 0.59 0.33 0.35 0.16 0.06
camembert-base 0.36 0.26 0.06 0.00 0.00
camembert-large 0.36 0.33 0.18 0.01 0.02
sentence-camembert-base 0.74 0.58 0.69 0.39 0.22
embed-multilingual-light-v3.0 0.82 0.70 0.77 0.52 0.35
embed-multilingual-v3.0 0.84 0.74 0.79 0.44 0.38
flaubert_base_cased 0.43 0.29 0.21 0.02 0.02
flaubert_base_uncased 0.49 0.30 0.22 0.03 0.02
flaubert_large_cased 0.32 0.29 0.02 0.00 0.01
e5-mistral-7b-instruct 0.90 0.74 0.83 0.64 0.45
multilingual-e5-base 0.83 0.67 0.80 0.53 0.36
multilingual-e5-large 0.83 0.69 0.81 0.59 0.38
multilingual-e5-small 0.82 0.65 0.76 0.52 0.27
udever-bloom-1b1 0.48 0.39 0.41 0.32 0.12
udever-bloom-560m 0.47 0.31 0.24 0.06 0.02
laser2 0.49 0.39 0.29 0.08 0.03
bge-m3-custom-fr 0.85 0.74 0.79 0.53 0.45
sentence_croissant_alpha_v0.2 0.82 0.72 0.79 0.60 0.45
sentence_croissant_alpha_v0.3 0.82 0.74 0.80 0.66 0.49
mistral-embed 0.81 0.78 0.79 0.68 0.57
LaBSE 0.68 0.55 0.55 0.23 0.20
all-MiniLM-L12-v2 0.69 0.67 0.61 0.34 0.33
all-MiniLM-L6-v2 0.67 0.63 0.60 0.27 0.28
distiluse-base-multilingual-cased-v2 0.75 0.62 0.65 0.29 0.27
multi-qa-MiniLM-L6-cos-v1 0.65 0.63 0.58 0.30 0.30
paraphrase-multilingual-MiniLM-L12-v2 0.73 0.62 0.66 0.38 0.27
paraphrase-multilingual-mpnet-base-v2 0.81 0.67 0.76 0.43 0.31
sentence-t5-base 0.76 0.63 0.67 0.40 0.28
sentence-t5-large 0.78 0.68 0.71 0.47 0.35
sentence-t5-xl 0.81 0.71 0.74 0.50 0.40
sentence-t5-xxl 0.82 0.75 0.79 0.56 0.46
text2vec-base-multilingual 0.63 0.56 0.50 0.26 0.19
text-embedding-3-large 0.92 0.80 0.87 0.73 0.60
text-embedding-3-small 0.89 0.74 0.87 0.66 0.52
text-embedding-ada-002 0.89 0.76 0.86 0.64 0.52
voyage-code-2 0.87 0.76 0.83 0.68 0.53
universal-sentence-encoder-multilingual-3 0.74 0.62 0.70 0.00 0.35
universal-sentence-encoder-multilingual-large-3 0.69 0.64 0.64 0.00 0.34
xlm-roberta-base 0.32 0.28 0.03 0.00 0.00
xlm-roberta-large 0.39 0.31 0.07 0.01 0.01
Table 11: Performance of each model for Retrieval and Reranking.
23