Tuwhy commited on
Commit
567cc51
·
verified ·
1 Parent(s): 37af4a2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -2
README.md CHANGED
@@ -11,6 +11,16 @@ tags:
11
  - multi-image
12
  - mllm
13
  ---
14
- [Qwen2-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct) model fine-tuned on [MIS training set](https://huggingface.co/datasets/Tuwhy/MIS_Train).
15
 
16
- You can find more details in our paper.
 
 
 
 
 
 
 
 
 
 
 
 
11
  - multi-image
12
  - mllm
13
  ---
 
14
 
15
+ # Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
16
+ ![motivation](./assets/motivation.png)
17
+ Our paper, code, data, models can be found at [MIS](https://dripnowhy.github.io/MIS/).
18
+
19
+ ## Description
20
+ [Qwen2-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct) model fine-tuned on [MIS training set](https://huggingface.co/datasets/Tuwhy/MIS_Train).
21
+
22
+ ## MIRgae
23
+ ![mirage](./assets/model_fig.png)
24
+ Here is example pipeline of [MIS training set](https://huggingface.co/datasets/Tuwhy/MIS_Train) and MIRage safety CoT label construction.
25
+
26
+ You can fine-tune Qwen2-VL series using [LlamaFactory](https://github.com/hiyouga/LLaMA-Factory).