Commit
·
2b6030e
1
Parent(s):
7569437
Update README.md
Browse files
README.md
CHANGED
@@ -85,21 +85,28 @@ test_evaluator(models, output_path="./")
|
|
85 |
```
|
86 |
**Test Result**:
|
87 |
The performance is measured using Pearson and Spearman correlation:
|
|
|
88 |
- On dev
|
|
|
89 |
| Model | Pearson correlation | Spearman correlation | #params |
|
90 |
| ------------- | ------------- | ------------- |------------- |
|
91 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.34 |90.15 | 336M |
|
92 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.11 |90.01 | 336M |
|
93 |
|
94 |
- On test:
|
|
|
|
|
95 |
**Pearson score**
|
96 |
-
|
|
|
97 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
98 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8863 | 0.9076 | 0.8824 | 0.9022 | 0.9223 | 0.8231 | 0.8461 |
|
99 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8816 | 0.9012 | 0.8836 | 0.8986 | 0.9204 | 0.8201 | 0.8423 |
|
100 |
|
101 |
**Spearman score**
|
102 |
-
|
|
|
|
|
103 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
104 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8803 | 0.8487 | 0.8788 | 0.8910 | 0.9216 | 0.8250 | 0.8078 |
|
105 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8757 | 0.8424 | 0.8801 | 0.8862 | 0.9199 | 0.8216 | 0.8038 |
|
|
|
85 |
```
|
86 |
**Test Result**:
|
87 |
The performance is measured using Pearson and Spearman correlation:
|
88 |
+
|
89 |
- On dev
|
90 |
+
|
91 |
| Model | Pearson correlation | Spearman correlation | #params |
|
92 |
| ------------- | ------------- | ------------- |------------- |
|
93 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.34 |90.15 | 336M |
|
94 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.11 |90.01 | 336M |
|
95 |
|
96 |
- On test:
|
97 |
+
|
98 |
+
|
99 |
**Pearson score**
|
100 |
+
|
101 |
+
| Model | STS-B | STS12-fr | STS13-fr | STS14-fr | STS15-fr | STS16-fr | SICK-fr |
|
102 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
103 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8863 | 0.9076 | 0.8824 | 0.9022 | 0.9223 | 0.8231 | 0.8461 |
|
104 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8816 | 0.9012 | 0.8836 | 0.8986 | 0.9204 | 0.8201 | 0.8423 |
|
105 |
|
106 |
**Spearman score**
|
107 |
+
|
108 |
+
|
109 |
+
| Model | STS-B | STS12-fr | STS13-fr | STS14-fr | STS15-fr | STS16-fr | SICK-fr |
|
110 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
111 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8803 | 0.8487 | 0.8788 | 0.8910 | 0.9216 | 0.8250 | 0.8078 |
|
112 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8757 | 0.8424 | 0.8801 | 0.8862 | 0.9199 | 0.8216 | 0.8038 |
|