Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

416

Full-text search

Active filters: vllm

matatonic/Mistral-Small-24B-Instruct-2501-6.5bpw-h8-exl2

Text Generation • Updated 15 days ago • 23

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q2_K-GGUF

Updated 15 days ago • 43

moot20/Mistral-Small-24B-Base-2501-MLX-4bit

Text Generation • Updated 15 days ago • 27

VoidStare/Mistral-Small-24B-Instruct-2501-EXL2-6.5bpw-h8

Text Generation • Updated 15 days ago • 9

jth01/Mistral-Small-24B-Instruct-2501-6.0bpw-h8-exl2

Text Generation • Updated 15 days ago • 33

Statuo/MS-24b-Instruct-EXL2-8bpw

Text Generation • Updated 15 days ago • 14

Statuo/MS-24b-Instruct-EXL2-6bpw

Text Generation • Updated 15 days ago • 24

Statuo/MS-24b-Instruct-EXL2-4bpw

Text Generation • Updated 15 days ago • 32

gghfez/Mistral-Small-24B-Instruct-2501

Text Generation • Updated 15 days ago • 84

gghfez/Mistral-Small-24B-Base-2501

Text Generation • Updated 15 days ago • 160

CuckmeisterFuller/Mistral-Small-24B-Instruct-2501-4bit-Q2-mlx

Updated 15 days ago • 32

CuckmeisterFuller/Mistral-Small-24B-Instruct-2501-bf16-Q2-mlx

Updated 15 days ago • 41

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_2.5bpw_H8

Text Generation • Updated 14 days ago • 24

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_3.5bpw_H8

Text Generation • Updated 14 days ago • 27

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_4bpw_H8

Text Generation • Updated 14 days ago • 41

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_5.0bpw_H8

Updated 14 days ago • 23

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_5.5bpw_H8

Text Generation • Updated 14 days ago • 16

Jellon/Mistral-Small-24B-Instruct-2501-exl2-6bpw

Text Generation • Updated 14 days ago • 26

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_6bpw_H8

Text Generation • Updated 14 days ago • 25

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_8bpw_H8

Text Generation • Updated 14 days ago • 29

Jellon/Mistral-Small-24B-Instruct-2501-exl2-4bpw

Text Generation • Updated 14 days ago • 21

KnutJaegersberg/Mistral-Small-24B-Instruct-2501-exl2-8.0bpw

Text Generation • Updated 14 days ago • 123

nextinddev/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

Updated 14 days ago • 2.84k

neuralmagic/Phi-3-vision-128k-instruct-W4A16-G128

Text Generation • Updated 4 days ago • 228 • 1

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q3_K_M-GGUF

Updated 14 days ago • 25

Statuo/MS-24b-Instruct-EXL2-3bpw

Text Generation • Updated 14 days ago • 8

lace1/Mistral-Small-24B-Base-2501-Q2_K-GGUF

Updated 13 days ago • 9

neuralmagic/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8

Text Generation • Updated 3 days ago • 235

neuralmagic/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16

Text Generation • Updated 2 days ago • 301

neuralmagic/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic

Text Generation • Updated 2 days ago • 57