Hugging Face's logo

Intel
/
Qwen2.5-1.5B-Instruct-int4-inc

Model card Files Community
n1ck-guo commited on
Commit
50abe4b
·
verified ·
1 Parent(s): bd792b5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -79,7 +79,7 @@ print(response)
79
 
80
  ### Evaluate the model
81
 
82
- pip3 install lm-eval==0.4.2
83
 
84
  ```bash
85
  git clone https://github.com/intel/auto-round
@@ -88,7 +88,7 @@ python -m auto_round --model "Intel/Qwen2.5-1.5B-Instruct-int4-inc" --eval --eva
88
  ```
89
 
90
  | Metric | BF16 | INT4(group_size 128) | INT4(group_size 32) |
91
- |:--------------| :----: | :----: |:------:|
92
  | Avg | 0.5646 | 0.5668 | 0.5699 |
93
  | mmlu | 0.6010 | 0.5876 | 0.5924 |
94
  | cmmlu | 0.6497 | 0.6146 | 0.6259 |
 
79
 
80
  ### Evaluate the model
81
 
82
+ pip3 install lm-eval==0.4.4
83
 
84
  ```bash
85
  git clone https://github.com/intel/auto-round
 
88
  ```
89
 
90
  | Metric | BF16 | INT4(group_size 128) | INT4(group_size 32) |
91
+ |:-------------- | :----: | :----: |:------:|
92
  | Avg | 0.5646 | 0.5668 | 0.5699 |
93
  | mmlu | 0.6010 | 0.5876 | 0.5924 |
94
  | cmmlu | 0.6497 | 0.6146 | 0.6259 |