cicdatopea commited on
Commit
6b6f5e5
·
verified ·
1 Parent(s): 7fa30e4

update cpu requirement

Browse files
Files changed (1) hide show
  1. README.md +5 -10
README.md CHANGED
@@ -164,19 +164,14 @@ Generated: Hello! How can I assist you today? 😊
164
  """
165
  ~~~
166
 
167
-
168
-
169
-
170
-
171
  ### INT4 Inference on CPU with ITREX(Recommended)
172
 
173
- **pip3 install auto-round** (it will install intel-extension-for-pytorch and intel-extension-for-transformers both). For intel cpu, it will prioritize using intel-extension-for-pytorch , for other cpus, it will prioritize using intel-extension-for-transformers.
174
 
175
- **To make sure to use qbits with intel-extension-for-transformers, please uninstall intel-extension-for-pytorch**
176
-
177
- intel-extension-for-transformers: faster repacking, slower inference,higher accuracy
178
-
179
- intel-extension-for-pytorch: much slower repacking, faster inference, lower accuracy
180
 
181
  ~~~python
182
  from auto_round import AutoRoundConfig ##must import for autoround format
 
164
  """
165
  ~~~
166
 
 
 
 
 
167
  ### INT4 Inference on CPU with ITREX(Recommended)
168
 
169
+ Requirements
170
 
171
+ ~~~bash
172
+ pip install auto-round
173
+ pip install intel-extension-for-transformers
174
+ ~~~
 
175
 
176
  ~~~python
177
  from auto_round import AutoRoundConfig ##must import for autoround format