czczup commited on
Commit
81c2a52
·
verified ·
1 Parent(s): c9cd8b0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -12
README.md CHANGED
@@ -94,25 +94,28 @@ This model can also conduct in-depth analysis of AAAI's official website and ide
94
 
95
  ## Evaluation
96
 
 
97
 
 
98
 
99
- **MultiModal Benchmark**
 
 
 
 
100
 
101
- | MME | MMB<sub>dev/test</sub> | MMB-CN<sub>dev/test</sub> | POPE | MMMU<sub>val/test</sub> | CMMMU<sub>val/test</sub> | Tiny<sub>LVLM</sub> | LLaVA<sub>bench</sub> |
102
- | -------------- | ---------------------- | ------------------------- | ---- | ----------------------- | ------------------------ | ------------------- | --------------------- |
103
- | 1672.3 / 341.1 | 76.6 / 75.4 | 71.5 / 70.1 | 87.2 | 39.1 / 35.3 | 34.8 / 34.0 | 344.5 | 76.3 |
104
 
105
- **Visual Question Answering**
 
 
106
 
107
- | VQAv2<sub>test</sub> | OKVQA<sub>val</sub> | TextVQA<sub>val</sub> | VizWiz<sub>val/test</sub> | AI2D<sub>test</sub> | GQA<sub>test</sub> | SQA<sub>test</sub> |
108
- | -------------------- | ------------------- | --------------------- | ------------------------- | ------------------- | ------------------ | ------------------ |
109
- | 80.9 | 64.2 | 65.8 | 58.3 / 57.3 | 70.23 | 62.4 | 91.2 |
110
 
111
- **Image Captioning**
 
 
112
 
113
- | COCO<sub>test</sub> | Flickr30K<sub>test</sub> | NoCaps<sub>val</sub> |
114
- | ------------------- | ------------------------ | -------------------- |
115
- | 141.8 | 84.3 | 120.4 |
116
 
117
 
118
  ## Citation
 
94
 
95
  ## Evaluation
96
 
97
+ **MultiModal Benchmark**
98
 
99
+ \* Training set observed.
100
 
101
+ | MathVista<br>(testmini) | MMB<br>(dev/test) | MMB−CN<br>(dev/test) | MMMU<br>(val/test) | CMMMU<br>(val/test) | MMVP | MME | POPE | Tiny LVLM | SEEDv1<br>(image) | LLaVA Wild | MM−Vet |
102
+ | ----------------------- | ----------------- | -------------------- | ---------------------------------------------------------------------------------- | ------------------- | ---- | -------------- | ---- | --------- | ----------------- | ---------- | ------ |
103
+ | 34.5 | 76.7&nbsp;/&nbsp;75.4 | 71.9&nbsp;/&nbsp;70.3 | 39.1&nbsp;/&nbsp;35.3 | 34.8&nbsp;/&nbsp;34.0 | 44.7 | 1675.1&nbsp;/&nbsp;348.6 | 87.1 | 343.2 | 73.2 | 73.2 | 46.7 |
104
+
105
+ **Image Captioning & Visual Question Answering**
106
 
107
+ \* Training set observed.
 
 
108
 
109
+ | COCO<br>(test) | Flickr30K<br>(test) | NoCaps<br>(val) | VQAv2<br>(testdev) | OKVQA<br>(val) | TextVQA<br>(val) | VizWiz<br>(val/test) | AI2D<br>(test) | GQA<br>(test) | ScienceQA<br>(image) |
110
+ | -------------- | ------------------- | --------------- | ------------------ | -------------- | ---------------- | -------------------- | -------------- | ------------- | -------------------- |
111
+ | 142.2\* | 85.3 | 120.8 | 80.9\* | 64.1\* | 65.9 | 59.0&nbsp;/&nbsp;57.3 | 70.3\* | 62.5\* | 90.1\* |
112
 
113
+ **Visual Grounding**
 
 
114
 
115
+ | RefCOCO<br>(val) | RefCOCO<br>(testA) | RefCOCO<br>(testB) | RefCOCO+<br>(val) | RefCOCO+<br>(testA) | RefCOCO+<br>(testB) | RefCOCO−g<br>(val) | RefCOCO−g<br>(test) |
116
+ | ---------------- | ------------------ | ------------------ | ----------------- | ------------------- | ------------------- | ------------------ | ------------------- |
117
+ | | | | | | | | |
118
 
 
 
 
119
 
120
 
121
  ## Citation