Rijgersberg commited on
Commit
66357b0
·
verified ·
1 Parent(s): 246e4d9

Put both models in the evaluation table

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -30,10 +30,12 @@ The model was then evaluated on [Mean Reciprocal Rank (MRR)](https://en.wikipedi
30
  When the model has to pick the positive example out of a pool of 32, it almost always ranks it first. When
31
  the pool is significantly enlarged to 10.000 functions, it still ranks the positive example highest most of the time.
32
 
33
- | Model | Pool size | MRR | Recall@1 |
34
- |-----------|-----------|------|----------|
35
- | ARM64BERT | 32 | 0.78 | 0.72 |
36
- | ARM64BERT | 10.000 | 0.58 | 0.56 |
 
 
37
 
38
  ## Purpose and use of the model
39
 
 
30
  When the model has to pick the positive example out of a pool of 32, it almost always ranks it first. When
31
  the pool is significantly enlarged to 10.000 functions, it still ranks the positive example highest most of the time.
32
 
33
+ | Model | Pool size | MRR | Recall@1 |
34
+ |----------------------|-----------|------|----------|
35
+ | ARM64BERT | 32 | 0.78 | 0.72 |
36
+ | ARM64BERT-embedding | 32 | 0.99 | 0.99 |
37
+ | ARM64BERT | 10.000 | 0.58 | 0.56 |
38
+ | ARM64BERT-embedding | 10.000 | 0.87 | 0.83 |
39
 
40
  ## Purpose and use of the model
41