Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,130

Full-text search

Active filters: llama-cpp

Trappu/Magnum-Picaro-0.7-V3-12b-Q5_K_M-GGUF

Updated Dec 25, 2024 • 1 • 2

Ransss/Nemo-12b-Humanize-KTO-Experimental-Latest-B-Q8_0-GGUF

Updated Jan 12 • 2 • 1

Guilherme34/01-v2-Q6_K-GGUF

Updated Dec 27, 2024 • 6 • 1

itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 28, 2024 • 17 • 1

gghfez/32B-Qwen2.5-Kunou-v1-Q4_K_M-GGUF

Updated Dec 30, 2024 • 36 • 4

jimmylam6666/Mistral-Nemo-BD-RP-Q8_0-GGUF

Question Answering • Updated Dec 30, 2024 • 7 • 2

itlwas/dolphin-2.9.4-gemma2-2b-Q4_K_M-GGUF

Updated Dec 30, 2024 • 10 • 1

newsletter/deepseek-moe-16b-chat-Q8_0-GGUF

Updated Dec 30, 2024 • 55 • 1

Triangle104/HuatuoGPT-o1-7B-Q4_K_M-GGUF

Text Generation • Updated Jan 6 • 16 • 1

UKPMAN0/WizardLM-7B-Uncensored-Q4_K_M-GGUF

Updated Jan 3 • 31 • 1

SickDodger/Mistral-7B-Instruct-v0.3-abliterated-Q6_K-GGUF

Updated Jan 5 • 30 • 1

SickDodger/Vikhr-Llama3.1-8B-Instruct-R-21-09-24-Q6_K-GGUF

Updated Jan 5 • 20 • 2

Smorty100/godot_dodo_4x_60k_llama_7b-Q4_K_M-GGUF

Updated Jan 5 • 69 • 1

BernTheCreator/Ava-1.5-12B-Q4_0-GGUF

Updated Jan 5 • 1 • 1

AlicanKiraz0/QwQ-32B-Preview-SenecaLLMv1.2-Q4_K_M-GGUF

Text Classification • Updated Mar 15 • 13 • 4

AlicanKiraz0/QwQ-32B-Preview-SenecaLLMv1.2-Q8_0-GGUF

Text Classification • Updated Mar 15 • 22 • 3

yoeven/multilingual-e5-large-instruct-Q5_0-GGUF

Updated Jan 6 • 11 • 2

yoeven/multilingual-e5-large-instruct-Q5_K_M-GGUF

Updated Jan 6 • 13 • 1

yoeven/multilingual-e5-large-instruct-Q3_K_S-GGUF

Updated Jan 6 • 9 • 1

narainp/jina-embeddings-GGUF

Feature Extraction • Updated Jan 8 • 79 • 1

MosRat/got_decoder_gguf

Updated Jan 10 • 121 • 1

MaayanYosef/Hammer2.1-7b-Q4_K_M-GGUF

Updated Jan 8 • 4 • 1

ngxson/MiniThinky-v2-1B-Llama-3.2-Q8_0-GGUF

Updated Jan 8 • 16 • 8

NikolayKozloff/phi-4-Q4_K_M-GGUF

Text Generation • Updated Jan 8 • 39 • 2

ProbioticFarmer/phi-4-Q5_K_M-GGUF

Text Generation • Updated Jan 8 • 8 • 1

ClaudioItaly/1800-9B-Q5_K_M-GGUF

Updated Jan 9 • 1 • 1

ClaudioItaly/1800-9B-Q3_K_L-GGUF

Updated Jan 9 • 2 • 1

vtriple/Qwen-2.5-7B-Threatflux-Q4_K_M-GGUF

Updated Jan 9 • 3 • 1

localattention/ShowUI-2B-Q4_K_M-GGUF

Updated Jan 9 • 13 • 1

itlwas/BioMistral-7B-Q4_K_M-GGUF

Text Generation • Updated Jan 9 • 14 • 1