Update README.md
Browse files
README.md
CHANGED
@@ -35,7 +35,7 @@ print(tokenizer.decode(model.generate(**tokenizer("There is a girl who likes adv
|
|
35 |
Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id 96d185fa6232a5ab685ba7c43e45d1dbb3bb906d
|
36 |
|
37 |
```bash
|
38 |
-
lm_eval --model hf --model_args pretrained="Intel/
|
39 |
```
|
40 |
|
41 |
|
|
|
35 |
Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id 96d185fa6232a5ab685ba7c43e45d1dbb3bb906d
|
36 |
|
37 |
```bash
|
38 |
+
lm_eval --model hf --model_args pretrained="Intel/Qwen1.5-0.5B-Chat-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu --batch_size 32
|
39 |
```
|
40 |
|
41 |
|