update cpu requirement
Browse files
README.md
CHANGED
@@ -164,19 +164,14 @@ Generated: Hello! How can I assist you today? 😊
|
|
164 |
"""
|
165 |
~~~
|
166 |
|
167 |
-
|
168 |
-
|
169 |
-
|
170 |
-
|
171 |
### INT4 Inference on CPU with ITREX(Recommended)
|
172 |
|
173 |
-
|
174 |
|
175 |
-
|
176 |
-
|
177 |
-
intel-extension-for-transformers
|
178 |
-
|
179 |
-
intel-extension-for-pytorch: much slower repacking, faster inference, lower accuracy
|
180 |
|
181 |
~~~python
|
182 |
from auto_round import AutoRoundConfig ##must import for autoround format
|
|
|
164 |
"""
|
165 |
~~~
|
166 |
|
|
|
|
|
|
|
|
|
167 |
### INT4 Inference on CPU with ITREX(Recommended)
|
168 |
|
169 |
+
Requirements
|
170 |
|
171 |
+
~~~bash
|
172 |
+
pip install auto-round
|
173 |
+
pip install intel-extension-for-transformers
|
174 |
+
~~~
|
|
|
175 |
|
176 |
~~~python
|
177 |
from auto_round import AutoRoundConfig ##must import for autoround format
|