Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

text-embeddings-inference

Carbon Emissions

Models

19,812

Full-text search

Active filters: llama-cpp

KnutJaegersberg/QwenLong-L1-32B-Q8_0-GGUF

Updated 3 days ago • 175 • 3

NikolayKozloff/Dans-PersonalityEngine-V1.3.0-12b-Q6_K-GGUF

Text Generation • Updated 6 days ago • 165 • 2

DavidAU/RolePlayLake-7B-Toxic-Q6_K-GGUF

Updated Apr 10, 2024 • 100 • 5

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 409 • 24

skyxiaobaibai/gemma-1.1-2b-it-Q4_0-GGUF

Updated May 27, 2024 • 25 • 1

NikolayKozloff/Llama-2-7b-Ukrainian-Q8_0-GGUF

Text Generation • Updated Jun 5, 2024 • 28 • 3

KeyurRamoliya/multilingual-e5-large-instruct-GGUF

Updated Aug 23, 2024 • 219 • 4

Triangle104/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated about 1 month ago • 21 • 1

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 63.5k • 31

toxibunny/mistral-small-unsloth-base-rpmax-base-v-curve-slerp-Q5_K_M-GGUF

Updated Oct 25, 2024 • 3 • 1

Cheatmeal/Lt-Llama-2-13b-hf-Q4_0-GGUF

Updated Dec 10, 2024 • 17 • 1

evgensoft/T-pro-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 13 • 8

Nekuromento/Hammer2.1-1.5b-Q8_0-GGUF

Updated Jan 15 • 3 • 1

roleplaiapp/SmallThinker-3B-Preview-Q3_K_S-GGUF

Text Generation • Updated Jan 16 • 3 • 1

matrixportal/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated Jan 30 • 121 • 2

Triangle104/Qwen2.5-14B-Instruct-1M-abliterated-Q4_K_S-GGUF

Text Generation • Updated Feb 2 • 15 • 1

cutycat2000x/HelpingAI2.5-10B-Q4_K_M-GGUF

Text Generation • Updated Feb 6 • 4 • 1

IntelligentEstate/Baby_Grok3-1.5b-iQ4_K_M-GGUF

Updated Feb 23 • 87 • 16

cutycat2000x/Dhanishtha-Large-Q8_0-GGUF

Updated Feb 24 • 4 • 1

cutycat2000x/Dhanishtha-Large-RAW-Q4_K_M-GGUF

Updated Mar 1 • 3 • 1

cutycat2000x/void-1-32b-Q4_K_M-GGUF

Text Generation • Updated Mar 10 • 2 • 2

Gemini/GemmaX2-28-9B-v0.1-Q2_K-GGUF

Translation • Updated Mar 17 • 137 • 2

isaiahbjork/orpheus-3b-0.1-ft-Q4_K_M-GGUF

Text-to-Speech • Updated Mar 20 • 29.1k • 49

matrixportal/Turkish-Llama-8b-Instruct-v0.1-GGUF

Text Generation • Updated Apr 6 • 240 • 2

Mantis2024/Dirty-Shirley-Writer-v0-abliterated-Q6_K-GGUF

Updated Mar 21 • 19 • 1

Mantis2024/Dirty-Shirley-Writer-v01-Uncensored-Q5_K_S-GGUF

Updated Mar 22 • 25 • 1

PatataAliena/Qwen2.5-VL-7B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 31 • 66 • 2

cherryDavid/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF

Updated Apr 24 • 253 • 4

Tesslate/UIGEN-T2-7B-Q8_0-GGUF

Text Generation • Updated 23 days ago • 4.3k • 131

ufoym/Qwen3-8B-Q4_K_M-GGUF

Text Generation • Updated 29 days ago • 343 • 3