Seongyun commited on
Commit
4024e17
·
verified ·
1 Parent(s): 5cec83c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - kaist-ai/Perception-Collection
5
+ - kaist-ai/Perception-Bench
6
+ language:
7
+ - en
8
+ metrics:
9
+ - pearsonr
10
+ - spearmanr
11
+ library_name: transformers
12
+ pipeline_tag: image-to-text
13
+ tags:
14
+ - Image-to-Text
15
+ - Visual Question Answering
16
+ - Text2Text Generation
17
+ ---
18
+ ## Links for Reference
19
+ - **Homepage:**
20
+ - **Repository: https://github.com/kaistAI/prometheus-vision**
21
+ - **Paper: https://arxiv.org/abs/2401.06591**
22
+ - **Point of Contact: [email protected]**
23
+ # TL;DR
24
+ Prometheus-Vision is the first open-source VLM specialized for evaluation purposes. Prometheus-Vision shows a high correlation with both GPT-4V and human evaluators, indicating its potential to be used as a cheap alternative for GPT-4V evaluation.