Update README.md
Browse files
README.md
CHANGED
@@ -111,7 +111,7 @@ messages = [
|
|
111 |
## 这张图片代表的是英特尔(Intel)公司。
|
112 |
|
113 |
```
|
114 |
-
|
115 |
## Evaluation the model
|
116 |
pip3 install git+https://github.com/open-compass/VLMEvalKit.git@7de2dcb. The evaluation process may encounter errors that require changing model backend or evaluation code. Detailed instructions will be provided in a future update.
|
117 |
```bash
|
@@ -119,11 +119,11 @@ auto-round-mllm --eval --model OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc --tasks MM
|
|
119 |
```
|
120 |
|Metric |16bits|Pile Calib INT4 |
|
121 |
|:-------------------|:------|:------|
|
122 |
-
|avg | | |
|
123 |
-
|MMBench_DEV_EN_V11 | | |
|
124 |
-
|ScienceQA_VAL | | |
|
125 |
-
|TextVQA_VAL | | |
|
126 |
-
|POPE | | |
|
127 |
|
128 |
### Generate the model
|
129 |
Here is the sample command to reproduce the model.
|
|
|
111 |
## 这张图片代表的是英特尔(Intel)公司。
|
112 |
|
113 |
```
|
114 |
+
|
115 |
## Evaluation the model
|
116 |
pip3 install git+https://github.com/open-compass/VLMEvalKit.git@7de2dcb. The evaluation process may encounter errors that require changing model backend or evaluation code. Detailed instructions will be provided in a future update.
|
117 |
```bash
|
|
|
119 |
```
|
120 |
|Metric |16bits|Pile Calib INT4 |
|
121 |
|:-------------------|:------|:------|
|
122 |
+
|avg |87.80 |87.63 |
|
123 |
+
|MMBench_DEV_EN_V11 |86.76 |86.30 |
|
124 |
+
|ScienceQA_VAL |91.65 |91.23 |
|
125 |
+
|TextVQA_VAL |85.45 |85.39 |
|
126 |
+
|POPE |87.32 |87.61 |
|
127 |
|
128 |
### Generate the model
|
129 |
Here is the sample command to reproduce the model.
|