altomek
/

Yi-1.5-34B-8bpw-EXL2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Yi-1.5-34B

ExLlamav2 8 bpw quants of https://huggingface.co/01-ai/Yi-1.5-34B

Downloads last month: 12

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Model tree for altomek/Yi-1.5-34B-8bpw-EXL2

Base model

01-ai/Yi-1.5-34B

Quantized

(13)

this model