Commit
·
8a8a7c5
1
Parent(s):
5af9693
Update README.md
Browse files
README.md
CHANGED
@@ -61,8 +61,8 @@ print(scores)
|
|
61 |
## Evaluation
|
62 |
***
|
63 |
|
64 |
-
We evaluated our model on 500 random queries from the mMARCO-fr train set (which were excluded from training). Each of these queries has at least one relevant and up to 200 irrelevant passages. Below, we
|
65 |
-
| | model |
|
66 |
|---:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------:|---------:|------------:|------------:|------------:|-------------:|
|
67 |
| 1 | **crossencoder-camembert-base-mmarcoFR** | 35.65 | 50.44 | 82.95 | 91.5 | 96.8 | 98.8 |
|
68 |
| 2 | [crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR](https://huggingface.co/antoinelouis/crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR) | 34.37 | 51.01 | 82.23 | 90.6 | 96.45 | 98.4 |
|
|
|
61 |
## Evaluation
|
62 |
***
|
63 |
|
64 |
+
We evaluated our model on 500 random queries from the mMARCO-fr train set (which were excluded from training). Each of these queries has at least one relevant and up to 200 irrelevant passages. Below, we compare the model performance with other cross-encoder models fine-tuned on the same dataset. We report the R-precision (RP), mean reciprocal rank (MRR), and recall at various cut-offs (R@k).
|
65 |
+
| | model | RP | MRR@10 | R@10 (↑) | R@20 | R@50 | R@100 |
|
66 |
|---:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------:|---------:|------------:|------------:|------------:|-------------:|
|
67 |
| 1 | **crossencoder-camembert-base-mmarcoFR** | 35.65 | 50.44 | 82.95 | 91.5 | 96.8 | 98.8 |
|
68 |
| 2 | [crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR](https://huggingface.co/antoinelouis/crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR) | 34.37 | 51.01 | 82.23 | 90.6 | 96.45 | 98.4 |
|