Image-Text-to-Text
Transformers
Safetensors
internvl_chat
feature-extraction
conversational
custom_code
lkdhy commited on
Commit
5a7388a
·
verified ·
1 Parent(s): e2b664b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -3
README.md CHANGED
@@ -1,3 +1,28 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - Code2Logic/GameQA-140K
5
+ - Code2Logic/GameQA-5K
6
+ base_model:
7
+ - OpenGVLab/InternVL2_5-8B
8
+ ---
9
+
10
+ ***This model (GameQA-InternVL2.5-8B) results from training InternVL2.5-8B with GRPO solely on our [GameQA-5K](https://huggingface.co/datasets/Code2Logic/GameQA-5K) (sampled from the full [GameQA-140K](https://huggingface.co/datasets/Gabriel166/GameQA-140K) dataset).***
11
+
12
+ # Evaluation Results on General Vision BenchMarks
13
+
14
+ <div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/evaluation_results_on_general_vision_benchmarks.png"></div>
15
+
16
+ ***(The inference and evaluation configurations were unified across both the original open-source models and our trained models.)***
17
+
18
+ # Code2Logic: Game-Code-Driven Data Synthesis for Enhancing VLMs General Reasoning
19
+
20
+ This is the first work, to the best of our knowledge, that leverages ***game code*** to synthesize multimodal reasoning data for ***training*** VLMs. Furthermore, when trained with a GRPO strategy solely on **GameQA** (synthesized via our proposed **Code2Logic** approach), multiple cutting-edge open-source models exhibit significantly enhanced out-of-domain generalization.
21
+
22
+ [[📖 Paper](https://arxiv.org/abs/2505.13886)] [[🤗 GameQA-140K Dataset](https://huggingface.co/datasets/Gabriel166/GameQA-140K)] [[🤗 GameQA-5K Dataset](https://huggingface.co/datasets/Code2Logic/GameQA-5K)] [[🤗 GameQA-InternVL3-8B](https://huggingface.co/Code2Logic/GameQA-InternVL3-8B) ] [[🤗 GameQA-Qwen2.5-VL-7B](https://huggingface.co/Code2Logic/GameQA-Qwen2.5-VL-7B)] [[🤗 GameQA-LLaVA-OV-7B](https://huggingface.co/Code2Logic/GameQA-llava-onevision-qwen2-7b-ov-hf) ]
23
+
24
+ <div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/categorized_30_games_images.png"></div>
25
+
26
+ ## News
27
+
28
+ * We've open-sourced the models trained with GRPO on GameQA on [Huggingface](https://huggingface.co/Code2Logic).