This is the 8bit BitsAndBytes quantized version of the https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct

Downloads last month
36
Safetensors
Model size
73.4B params
Tensor type
F32
BF16
I8
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Maverick17/Qwen2.5-VL-72B-Instruct-bnb-8bit

Unable to build the model tree, the base model loops to the model itself. Learn more.