LEI Tong's picture

1 1

LEI Tong

LeiTong

·

AI & ML interests

None yet

Recent Activity

reacted to lxasqjc's post with 👍 6 days ago

⚡ Can Stable Diffusion's visual expertise enhance Llama-3.2? 🚀 Lavender: efficiently fine-tunes advanced vision-language models by aligning their text-vision attention with Stable Diffusion. Paper: https://huggingface.co/papers/2502.06814 🔑 Key Highlights: ✅ Significant Gains: +30% on 20 tasks, +68% on OOD WorldMedQA ✅ Data-Efficient: Needs only 0.13M samples (~2.5% of typical VLM datasets) ✅ Low Compute: Finetunes in ~1 day on 8 NVIDIA A10G GPUs ✅ Model-Agnostic: Works with Llama-3.2-11B, MiniCPM-Llama3-v2.5 & more ✅ Precise Alignment: Transfers strong text-vision alignment from Stable Diffusion ✅ Open-Source: Code, data & finetuned models will be available 👥 Discuss live at: https://www.alphaxiv.org/abs/2502.06814 🔗 Project Page: https://astrazeneca.github.io/vlm/

upvoted a paper 2 months ago

An Image is Worth Multiple Words: Learning Object Level Concepts using Multi-Concept Prompt Learning

liked a model 3 months ago

lambdalabs/miniSD-diffusers

View all activity

Organizations

None yet

models

None public yet

datasets

None public yet