English
yintongl commited on
Commit
2c9725f
·
verified ·
1 Parent(s): 5a5cf71

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -23
README.md CHANGED
@@ -15,6 +15,31 @@ Inference of this model is compatible with AutoGPTQ's Kernel.
15
 
16
 
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  ### Evaluate the model
19
 
20
  Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id 96d185fa6232a5ab685ba7c43e45d1dbb3bb906d
@@ -41,29 +66,6 @@ lm_eval --model hf --model_args pretrained="Intel/opt-13b-int4-inc",autogptq=Tru
41
 
42
 
43
 
44
- ### Reproduce the model
45
-
46
- Here is the sample command to reproduce the model
47
-
48
- ```bash
49
- git clone https://github.com/intel/auto-round
50
- cd auto-round/examples/language-modeling
51
- pip install -r requirements.txt
52
- python3 main.py \
53
- --model_name facebook/opt-13b \
54
- --device 0 \
55
- --group_size 128 \
56
- --bits 4 \
57
- --iters 1000 \
58
- --deployment_device 'gpu' \
59
- --minmax_lr 2e-3 \
60
- --disable_quanted_input \
61
- --output_dir "./tmp_autoround" \
62
-
63
- ```
64
-
65
-
66
-
67
 
68
  ## Caveats and Recommendations
69
 
 
15
 
16
 
17
 
18
+ ### Reproduce the model
19
+
20
+ Here is the sample command to reproduce the model
21
+
22
+ ```bash
23
+ git clone https://github.com/intel/auto-round
24
+ cd auto-round/examples/language-modeling
25
+ pip install -r requirements.txt
26
+ python3 main.py \
27
+ --model_name facebook/opt-13b \
28
+ --device 0 \
29
+ --group_size 128 \
30
+ --bits 4 \
31
+ --iters 1000 \
32
+ --deployment_device 'gpu' \
33
+ --minmax_lr 2e-3 \
34
+ --disable_quanted_input \
35
+ --output_dir "./tmp_autoround" \
36
+
37
+ ```
38
+
39
+
40
+
41
+
42
+
43
  ### Evaluate the model
44
 
45
  Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id 96d185fa6232a5ab685ba7c43e45d1dbb3bb906d
 
66
 
67
 
68
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69
 
70
  ## Caveats and Recommendations
71