5.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2

8bit heads. Default measurement dataset.

Downloads last month
13
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for MarsupialAI/EVA-Qwen2.5-14B-v0.2_EXL2_5.0BPW_H8

Base model

Qwen/Qwen2.5-14B
Quantized
(85)
this model