Put both models in the evaluation table
Browse files
README.md
CHANGED
@@ -30,10 +30,12 @@ The model was then evaluated on [Mean Reciprocal Rank (MRR)](https://en.wikipedi
|
|
30 |
When the model has to pick the positive example out of a pool of 32, it almost always ranks it first. When
|
31 |
the pool is significantly enlarged to 10.000 functions, it still ranks the positive example highest most of the time.
|
32 |
|
33 |
-
| Model
|
34 |
-
|
35 |
-
| ARM64BERT
|
36 |
-
| ARM64BERT
|
|
|
|
|
37 |
|
38 |
## Purpose and use of the model
|
39 |
|
|
|
30 |
When the model has to pick the positive example out of a pool of 32, it almost always ranks it first. When
|
31 |
the pool is significantly enlarged to 10.000 functions, it still ranks the positive example highest most of the time.
|
32 |
|
33 |
+
| Model | Pool size | MRR | Recall@1 |
|
34 |
+
|----------------------|-----------|------|----------|
|
35 |
+
| ARM64BERT | 32 | 0.78 | 0.72 |
|
36 |
+
| ARM64BERT-embedding | 32 | 0.99 | 0.99 |
|
37 |
+
| ARM64BERT | 10.000 | 0.58 | 0.56 |
|
38 |
+
| ARM64BERT-embedding | 10.000 | 0.87 | 0.83 |
|
39 |
|
40 |
## Purpose and use of the model
|
41 |
|