Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

85,899

Full-text search

Active filters: gguf

unsloth/DeepSeek-V3-GGUF

Updated Jan 12 • 170k • 116

city96/HunyuanVideo-gguf

Text-to-Video • Updated Dec 17, 2024 • 29.9k • 127

bartowski/uncensoredai_UncensoredLM-DeepSeek-R1-Distill-Qwen-14B-GGUF

Text Generation • Updated 14 days ago • 51.9k • 18

prithivMLmods/Megatron-Opus-14B-2.0-GGUF

Text Generation • Updated 7 days ago • 213 • 8

dimsavva/phi4-noesis

Updated 1 day ago • 210 • 8

prithivMLmods/Open-R1-Mini-Experimental-GGUF

Image-Text-to-Text • Updated 4 days ago • 1.49k • 8

bartowski/NousResearch_DeepHermes-3-Llama-3-8B-Preview-GGUF

Text Generation • Updated 2 days ago • 1.84k • 8

bartowski/TheDrummer_Cydonia-24B-v2-GGUF

Text Generation • Updated 1 day ago • 2.73k • 8

openbmb/MiniCPM-o-2_6-gguf

Any-to-Any • Updated 29 days ago • 57.1k • 73

unsloth/DeepSeek-R1-Distill-Qwen-14B-GGUF

Updated 22 days ago • 201k • 63

bartowski/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • Updated 25 days ago • 215k • 49

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated 18 days ago • 231k • 61

bartowski/deepseek-r1-qwen-2.5-32B-ablated-GGUF

Text Generation • Updated 23 days ago • 163k • 66

prithivMLmods/Elita-1-GGUF

Text Generation • Updated 9 days ago • 157 • 7

prithivMLmods/Sqweeks-7B-Instruct-GGUF

Text Generation • Updated 9 days ago • 123 • 8

prithivMLmods/Feynman-Grpo-Exp-GGUF

Text Generation • Updated 9 days ago • 56 • 7

prithivMLmods/Elita-0.1-Distilled-R1-GGUF

Text Generation • Updated 6 days ago • 130 • 7

QuantFactory/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • Updated Jul 29, 2024 • 18.6k • 65

city96/t5-v1_1-xxl-encoder-gguf

Updated Aug 20, 2024 • 55.3k • 282

SakuraLLM/Sakura-14B-Qwen2.5-v1.0-GGUF

Updated Oct 15, 2024 • 169k • 52

city96/FastHunyuan-gguf

Text-to-Video • Updated Jan 8 • 20.5k • 30

lmstudio-community/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • Updated 27 days ago • 821k • 58

bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated 25 days ago • 162k • 31

mradermacher/DeepSeek-R1-Distill-Qwen-7B-Uncensored-i1-GGUF

Updated 25 days ago • 93.2k • 36

allenai/OLMoE-1B-7B-0125-Instruct-GGUF

Updated 2 days ago • 871 • 6

mradermacher/Janus-Pro-7B-LM-GGUF

Updated 16 days ago • 88.4k • 26

bartowski/huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-GGUF

Text Generation • Updated 15 days ago • 48.9k • 17

prithivMLmods/Jolt-v0.1-GGUF

Text Generation • Updated 9 days ago • 76 • 7

prithivMLmods/Megatron-Corpus-14B-Exp.v2-GGUF

Text Generation • Updated 9 days ago • 114 • 7

hooman650/MedQwen3B-Reasoner

Text Generation • Updated 5 days ago • 768 • 8