Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,140

Full-text search

Active filters: llama-cpp

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q8_0-GGUF

Text Generation • Updated Jan 29 • 19 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_S-GGUF

Updated Jan 29 • 67 • 4

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_M-GGUF

Updated Jan 29 • 24 • 1

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q6_K-GGUF

Text Generation • Updated Jan 29 • 41 • 1

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q3_K_L-GGUF

Text Generation • Updated Jan 29 • 12 • 1

DoppelReflEx/MN-12B-Kakigori-Q6_K-GGUF

Updated Jan 29 • 4 • 1

Theros/Qwen2.5-ColdBrew-R1-Q4_K_M-GGUF

Updated Jan 29 • 1 • 1

NikolayKozloff/Virtuoso-Lite-Q8_0-GGUF

Updated Jan 29 • 2 • 1

NikolayKozloff/Virtuoso-Lite-Q6_K-GGUF

Updated Jan 29 • 1 • 1

ZeroXClem/Qwen2.5-7B-CelestialHarmony-1M-Q4_K_M-GGUF

Updated Jan 30 • 1 • 2

ozone-research/2x-lite-Q4_K_M-GGUF

Updated Jan 30 • 3 • 1

cwjoneill/finetuned_llama3.2-F16-GGUF

Updated Jan 30 • 5 • 1

alig01/mt5-small-sum-de-mit-v1-Q4_K_M-GGUF

Summarization • Updated Jan 30 • 20 • 1

pradma/DeepSeek-R1-Distill-Qwen-7B-abliterated-Q8_0-GGUF

Updated Jan 30 • 8 • 1

NikolayKozloff/YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

Text Generation • Updated Jan 30 • 2 • 1

NikolayKozloff/YuE-s2-1B-general-Q8_0-GGUF

Text Generation • Updated Jan 30 • 3 • 1

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated Jan 30 • 23 • 2

matrixportal/deepseek-math-7b-rl-GGUF

Updated Jan 30 • 547 • 2

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q3_K_S-GGUF

Updated Jan 30 • 35 • 1

Triangle104/Mistral-Small-24B-Instruct-2501-Q5_K_S-GGUF

Updated Jan 30 • 12 • 1

lolnoyarite/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated Jan 30 • 7 • 1

Triangle104/L3.1-8b-RP-Ink-Q4_K_S-GGUF

Updated Jan 30 • 3 • 1

IntelligentEstate/Israfel_Qwen2.6-iQ4_K_M-GGUF

Text Generation • Updated Feb 2 • 22 • 2

Triangle104/L3.1-8b-RP-Ink-Q4_K_M-GGUF

Updated Jan 30 • 8 • 1

NikolayKozloff/Llama-3.1-8B-ReasonChatV1-Q8_0-GGUF

Updated Jan 30 • 2 • 1

Triangle104/L3.1-8b-RP-Ink-Q5_K_S-GGUF

Updated Jan 30 • 6 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Llama3-8B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 10 • 1

Triangle104/L3.1-8b-RP-Ink-Q5_K_M-GGUF

Updated Jan 30 • 5 • 1

Triangle104/L3.1-8b-RP-Ink-Q6_K-GGUF

Updated Jan 30 • 4 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 35 • 3