lkdhy commited on
Commit
4f6f59a
·
verified ·
1 Parent(s): 6a700f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -6,6 +6,25 @@ base_model:
6
  - Qwen/Qwen2.5-VL-7B-Instruct
7
  ---
8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  # Code2Logic: Game-Code-Driven Data Synthesis for Enhancing VLMs General Reasoning
10
 
11
  This is the first work, to the best of our knowledge, that leverages ***game code*** to synthesize multimodal reasoning data for ***training*** VLMs. Furthermore, when trained solely with a GRPO strategy on **GameQA** (synthesized via our proposed **Code2Logic** approach), multiple cutting-edge open-source models exhibit significantly enhanced out-of-domain generalization.
 
6
  - Qwen/Qwen2.5-VL-7B-Instruct
7
  ---
8
 
9
+ ***This model (GameQA-Qwen2.5-VL-7B) results from trainning Qwen2.5-VL-7B with GRPO purely on our [GameQA](https://huggingface.co/datasets/Gabriel166/GameQA-140K) dataset.***
10
+
11
+ # Evaluation Results on General Vision BenchMarks
12
+
13
+ <div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/evaluation_results_on_general_vision_benchmarks.png"></div>
14
+
15
+ It's also found that getting trained on 5k samples from our GameQA dataset can lead to better results than on [multimodal-open-r1-8k-verified](https://huggingface.co/datasets/lmms-lab/multimodal-open-r1-8k-verified).
16
+
17
+ <div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/GameQA_generalizes_better.png"></div>
18
+
19
+ # Code2Logic: Game-Code-Driven Data Synthesis for Enhancing VLMs General Reasoning
20
+
21
+ This is the first work, to the best of our knowledge, that leverages ***game code*** to synthesize multimodal reasoning data for ***training*** VLMs. Furthermore, when trained solely with a GRPO strategy on **GameQA** (synthesized via our proposed **Code2Logic** approach), multiple cutting-edge open-source models exhibit significantly enhanced out-of-domain generalization.
22
+
23
+ [[📖 Paper](https://arxiv.org/abs/2505.13886)] [🤗 [GameQA-140K Dataset](https://huggingface.co/datasets/Gabriel166/GameQA-140K)] [🤗 [GameQA-InternVL3-8B](https://huggingface.co/Code2Logic/GameQA-InternVL3-8B) ] [🤗 [GameQA-Qwen2.5-VL-7B](https://huggingface.co/Code2Logic/GameQA-Qwen2.5-VL-7B)] [🤗 [GameQA-LLaVA-OV-7B](https://huggingface.co/Code2Logic/GameQA-llava-onevision-qwen2-7b-ov-hf) ]
24
+
25
+ <div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/categorized_30_games_images.png"></div>
26
+
27
+
28
  # Code2Logic: Game-Code-Driven Data Synthesis for Enhancing VLMs General Reasoning
29
 
30
  This is the first work, to the best of our knowledge, that leverages ***game code*** to synthesize multimodal reasoning data for ***training*** VLMs. Furthermore, when trained solely with a GRPO strategy on **GameQA** (synthesized via our proposed **Code2Logic** approach), multiple cutting-edge open-source models exhibit significantly enhanced out-of-domain generalization.