update README
Browse filesSigned-off-by: yuwenzho <[email protected]>
README.md
CHANGED
|
@@ -25,14 +25,14 @@ The calibration dataloader is the train dataloader. The default calibration samp
|
|
| 25 |
|
| 26 |
The linear module **bert.encoder.layer.6.attention.self.key** falls back to fp32 to meet the 1% relative accuracy loss.
|
| 27 |
|
| 28 |
-
|
| 29 |
|
| 30 |
| |INT8|FP32|
|
| 31 |
|---|:---:|:---:|
|
| 32 |
| **Accuracy (eval-f1)** |0.9039|0.9097|
|
| 33 |
| **Model size (MB)** |33.5|127|
|
| 34 |
|
| 35 |
-
|
| 36 |
|
| 37 |
```python
|
| 38 |
from optimum.intel.neural_compressor.quantization import IncQuantizedModelForSequenceClassification
|
|
|
|
| 25 |
|
| 26 |
The linear module **bert.encoder.layer.6.attention.self.key** falls back to fp32 to meet the 1% relative accuracy loss.
|
| 27 |
|
| 28 |
+
#### Test result
|
| 29 |
|
| 30 |
| |INT8|FP32|
|
| 31 |
|---|:---:|:---:|
|
| 32 |
| **Accuracy (eval-f1)** |0.9039|0.9097|
|
| 33 |
| **Model size (MB)** |33.5|127|
|
| 34 |
|
| 35 |
+
#### Load with optimum:
|
| 36 |
|
| 37 |
```python
|
| 38 |
from optimum.intel.neural_compressor.quantization import IncQuantizedModelForSequenceClassification
|