OPEA
/

Llama-3.3-70B-Instruct-int3-sym-inc

Model card Files Files and versions Community

cicdatopea commited on 6 days ago

Commit

f27f93b

·

verified ·

1 Parent(s): 54cea49

revert the change

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -122,9 +122,7 @@ lm-eval --model hf --model_args pretrained=OPEA/Llama-3.3-70B-Instruct-int3-sym-
 | boolq                       | 0.8865                   | 0.8911                    |             |
 | arc_easy                    | 0.8624                   | 0.8523                    | 0.2643      |
 | arc_challenge               | 0.6109                   | 0.5956                    |             |
-| gsm8k(5shot) strict match?   | 0.9083                   | 0.9067                    |             |
-gsm8k data is not correct, probably flexible-extract
 ## Generate the model

 | boolq                       | 0.8865                   | 0.8911                    |             |
 | arc_easy                    | 0.8624                   | 0.8523                    | 0.2643      |
 | arc_challenge               | 0.6109                   | 0.5956                    |             |
+| gsm8k(5shot) strict match   | 0.9083                   | 0.9067                    |             |
 ## Generate the model