Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

text-embeddings-inference

Carbon Emissions

Models

19,888

Full-text search

Active filters: llama-cpp

KnutJaegersberg/QwenLong-L1-32B-Q8_0-GGUF

Updated 4 days ago • 332 • 3

KeyurRamoliya/multilingual-e5-large-instruct-GGUF

Updated Aug 23, 2024 • 380 • 5

DavidAU/RolePlayLake-7B-Toxic-Q6_K-GGUF

Updated Apr 10, 2024 • 101 • 5

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 456 • 24

hus960/Unholy-Aura-Llama-3-8B-Q4_K_M-GGUF

Updated Apr 24, 2024 • 4 • 2

skyxiaobaibai/gemma-1.1-2b-it-Q4_0-GGUF

Updated May 27, 2024 • 26 • 1

NikolayKozloff/Llama-2-7b-Ukrainian-Q8_0-GGUF

Text Generation • Updated Jun 5, 2024 • 21 • 3

Triangle104/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Apr 28 • 23 • 1

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 61.1k • 31

toxibunny/mistral-small-unsloth-base-rpmax-base-v-curve-slerp-Q5_K_M-GGUF

Updated Oct 25, 2024 • 3 • 1

Cheatmeal/Lt-Llama-2-13b-hf-Q4_0-GGUF

Updated Dec 10, 2024 • 19 • 1

hus960/LLaMA-3.1-8B-Infinity3M-Kobo-Q4_K_M-GGUF

Updated Dec 14, 2024 • 6 • 1

hus960/OLMo-2-1124-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 5 • 8 • 1

Nekuromento/Hammer2.1-1.5b-Q8_0-GGUF

Updated Jan 15 • 3 • 1

roleplaiapp/SmallThinker-3B-Preview-Q3_K_S-GGUF

Text Generation • Updated Jan 16 • 7 • 1

matrixportal/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated Jan 30 • 122 • 2

matrixportal/OpenR1-Qwen-7B-Turkish-GGUF

Updated Feb 24 • 17 • 2

nocturne23/gemma-3-12b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 13 • 44 • 1

Gemini/GemmaX2-28-9B-v0.1-Q2_K-GGUF

Translation • Updated Mar 17 • 144 • 2

isaiahbjork/orpheus-3b-0.1-ft-Q4_K_M-GGUF

Text-to-Speech • Updated Mar 20 • 29k • 49

matrixportal/Turkish-Llama-8b-Instruct-v0.1-GGUF

Text Generation • Updated Apr 6 • 261 • 2

Mantis2024/Dirty-Shirley-Writer-v0-abliterated-Q6_K-GGUF

Updated Mar 21 • 19 • 1

Mantis2024/Dirty-Shirley-Writer-v01-Uncensored-Q5_K_S-GGUF

Updated Mar 22 • 29 • 1

openfree/Gemma-3-R1984-27B-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 30 • 1.31k • 15

openfree/Gemma-3-R1984-12B-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 359 • 14

PatataAliena/Qwen2.5-VL-7B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 31 • 63 • 2

sydneyfong/Qwerky-QwQ-32B-Q6_K-GGUF

Updated Apr 2 • 2 • 1

cludyw/3b-zh-ft-research_release-Q8_0-GGUF

Text-to-Speech • Updated Apr 20 • 23 • 1

cherryDavid/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF

Updated Apr 24 • 194 • 4

Tesslate/UIGEN-T2-7B-Q8_0-GGUF

Text Generation • Updated 24 days ago • 4.26k • 131