antoinelouis commited on
Commit
8a8a7c5
·
1 Parent(s): 5af9693

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -61,8 +61,8 @@ print(scores)
61
  ## Evaluation
62
  ***
63
 
64
- We evaluated our model on 500 random queries from the mMARCO-fr train set (which were excluded from training). Each of these queries has at least one relevant and up to 200 irrelevant passages. Below, we compared the model performance with other cross-encoder models fine-tuned on the same dataset:
65
- | | model | r-precision | mrr@10 | recall@10 (↑) | recall@20 | recall@50 | recall@100 |
66
  |---:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------:|---------:|------------:|------------:|------------:|-------------:|
67
  | 1 | **crossencoder-camembert-base-mmarcoFR** | 35.65 | 50.44 | 82.95 | 91.5 | 96.8 | 98.8 |
68
  | 2 | [crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR](https://huggingface.co/antoinelouis/crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR) | 34.37 | 51.01 | 82.23 | 90.6 | 96.45 | 98.4 |
 
61
  ## Evaluation
62
  ***
63
 
64
+ We evaluated our model on 500 random queries from the mMARCO-fr train set (which were excluded from training). Each of these queries has at least one relevant and up to 200 irrelevant passages. Below, we compare the model performance with other cross-encoder models fine-tuned on the same dataset. We report the R-precision (RP), mean reciprocal rank (MRR), and recall at various cut-offs (R@k).
65
+ | | model | RP | MRR@10 | R@10 (↑) | R@20 | R@50 | R@100 |
66
  |---:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------:|---------:|------------:|------------:|------------:|-------------:|
67
  | 1 | **crossencoder-camembert-base-mmarcoFR** | 35.65 | 50.44 | 82.95 | 91.5 | 96.8 | 98.8 |
68
  | 2 | [crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR](https://huggingface.co/antoinelouis/crossencoder-mMiniLMv2-L12-H384-distilled-from-XLMR-Large-mmarcoFR) | 34.37 | 51.01 | 82.23 | 90.6 | 96.45 | 98.4 |