Hugging Face's logo

jarrelscy
/
Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit

Text Generation
Transformers
Safetensors
mixtral
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
3

Model Card for Model ID

Optimum GPTQ quantized 8-bit version of Mixtral-8x22B-Instruct-v0.1
See original model card for more information.

How to load

Downloads last month
98
Safetensors
Model size
19.2B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.