5.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2

8bit heads. Default measurement dataset.

Downloads last month
10
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for MarsupialAI/EVA-Qwen2.5-14B-v0.2_EXL2_5.0BPW_H8

Base model

Qwen/Qwen2.5-14B
Quantized
(77)
this model