Q4_K_M quantization for Mistral-Small-Instruct-2501 model

GGUF

Model size

23.6B params

Architecture

llama

4-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for dataplayer12/Mistral-Small-24B-Instruct-Q4_K_M-GGUF

Base model

Finetuned

Quantized

(61)

this model