Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,631

Full-text search

Active filters: llama-cpp

ozone-ai/0x-lite-Q4_K_M-GGUF

Updated 18 days ago • 256 • 15

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated Nov 5, 2024 • 1.29k • 35

prithivMLmods/GWQ-9B-Preview2-Q8_0-GGUF

Text Generation • Updated Jan 8 • 50 • 7

prithivMLmods/GWQ-9B-Preview-Q6_K-GGUF

Text Generation • Updated Jan 8 • 16 • 7

roleplaiapp/Janus-Pro-7B-LM-Q4_K_S-GGUF

Text Generation • Updated 9 days ago • 2.17k • 3

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 625 • 21

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3, 2024 • 796 • 59

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26, 2024 • 5.07k • 54

t-tech/T-pro-it-1.0-Q4_K_M-GGUF

Updated Dec 17, 2024 • 345 • 3

prithivMLmods/GWQ-9B-Preview2-GGUF

Text Generation • Updated Jan 8 • 27 • 7

prithivMLmods/GWQ-9B-Preview2-Q6_K-GGUF

Text Generation • Updated Jan 8 • 22 • 7

prithivMLmods/GWQ-9B-Preview2-Q5_K_M-GGUF

Text Generation • Updated Jan 8 • 36 • 7

prithivMLmods/GWQ-9B-Preview-Q5_K_M-GGUF

Text Generation • Updated Jan 8 • 18 • 7

prithivMLmods/GWQ-9B-Preview-Q8_0-GGUF

Text Generation • Updated Jan 8 • 20 • 7

Donnyed/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF

Updated 22 days ago • 23.1k • 11

nanowell/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF

Updated 22 days ago • 1.39k • 4

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated 20 days ago • 62 • 2

jimi0209/lb-reranker-0.5B-v1.0-Q5_K_M-GGUF

Text Generation • Updated 20 days ago • 84 • 2

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q8_0-GGUF

Text Generation • Updated 14 days ago • 70.6k • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated 13 days ago • 59 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated 12 days ago • 474 • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated 12 days ago • 125 • 2

Triangle104/DeepSeek-R1-Distill-Qwen-7B-abliterated-Q4_K_M-GGUF

Updated 12 days ago • 1.61k • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated 12 days ago • 745 • 2

NikolayKozloff/Art-Skynet-3B-Q8_0-GGUF

Updated 7 days ago • 82 • 2

Xiaojian9992024/Qwen2.5-THREADRIPPER-Small-Q8_0-GGUF

Updated 6 days ago • 22 • 2

DoesntKnowAI/Plasma-8B-Q8_0-GGUF

Updated 3 days ago • 27 • 2

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 925 • 3

NikolayKozloff/csmpt7b-Czech-GGUF

Updated Apr 6, 2024 • 35 • 4

DavidAU/RolePlayLake-7B-Q6_K-GGUF

Updated Apr 10, 2024 • 70 • 2