Hugging Face's logo

solidrust
/
Mini-Mixtral-v0.2-2x7B-AWQ

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
frankenmoe
Merge
mergekit
lazymergekit
unsloth/mistral-7b-v0.2
mistralai/Mistral-7B-Instruct-v0.2
quantized
4-bit precision
AWQ
Inference Endpoints
chatml
text-generation-inference
awq
Model card Files Community

NeuralNovel/Mini-Mixtral-v0.2 AWQ

image/jpeg

Model Summary

Mini-Mixtral-v0.2 is a Mixture of Experts (MoE) made with the following models using LazyMergekit:

Downloads last month
89
Safetensors
Model size
1.95B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for solidrust/Mini-Mixtral-v0.2-2x7B-AWQ

Base model

NeuralNovel/Mini-Mixtral-v0.2
Quantized
(3)
this model

Collection including solidrust/Mini-Mixtral-v0.2-2x7B-AWQ