Hugging Face's logo

huihui-ai
/
Qwen2.5-VL-7B-Instruct-abliterated

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_5_vl
multimodal
abliterated
uncensored
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
5

Quantized Version

#4
by bobwu - opened
Discussion
bobwu
•
edited 5 days ago

Hi @huihui-ai , thanks for your hard work. Could you provide Quantized Version like 4bit , I tried to quantized it by myself, but failed -_-

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment