Intel
/

Qwen1.5-0.5B-Chat-int4-inc

Model card Files Files and versions Community

yintongl commited on May 21, 2024

Commit

98c109a

·

verified ·

1 Parent(s): ea90ce7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -51,7 +51,7 @@ lm_eval --model hf --model_args pretrained="Intel/Qwen1.5-0.5B-Chat-int4-inc",au
-| Metric         | BF16   | INT4   |
 | -------------- | ------ | ------ |
 | Avg.           | 0.3896 | 0.3848 |
 | mmlu           | 0.3162 | 0.2911 |

+| Metric         | FP16   | INT4   |
 | -------------- | ------ | ------ |
 | Avg.           | 0.3896 | 0.3848 |
 | mmlu           | 0.3162 | 0.2911 |