Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

20,313

Full-text search

Active filters: llama-cpp

mjschock/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Dec 16, 2024 • 6 • 1

ShadowKronos/L3-8B-Stheno-v3.3-32K-Q8_0-GGUF

Updated Jul 14, 2024 • 1

mjschock/TinyLlama_v1.1_math_code-Q4_K_M-GGUF

Updated Jul 14, 2024 • 28 • 3

zsolx2/SambaLingo-Hungarian-Chat-Q4_0-GGUF

Updated Jul 14, 2024 • 46

zsolx2/SambaLingo-Hungarian-Base-Q4_0-GGUF

Updated Jul 14, 2024 • 31

zsolx2/szurkemarha-samba-Q4_0-GGUF

Updated Jul 15, 2024 • 3

joshnader/meditron-7b-Q4_K_M-GGUF

Updated Jul 15, 2024 • 5

harangstar/Llama3-Q4_K_M-GGUF

Updated Jul 15, 2024

saurabh1484/Meta-Llama-3-8B-Q4_0-GGUF

Text Generation • Updated Jul 15, 2024 • 4

saurabh1484/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 2

jsfs11/L3-8B-Niitama-v1-Q5_K_M-GGUF-imatrix

Updated Jul 15, 2024 • 1 • 1

Razrien/L3-8B-Tamamo-v1-Q8_0-GGUF

Updated Jul 15, 2024 • 3

v000000/L3-15B-EtherealMaid-t0.0001-Q5_K_M-GGUF

Updated Jul 15, 2024 • 3 • 1

jsfs11/L3-8B-Tamamo-v1-Q5_K_M-GGUF-imatrix

Updated Jul 15, 2024

zsolx2/Yi-1.5-34B-Chat-16K-Q4_0-GGUF

Updated Jul 15, 2024 • 11

v000000/L3-15B-MythicalMaid-t0.0001-Q5_K_M-GGUF

Updated Jul 15, 2024 • 2 • 1

niancheng/gte-Qwen2-1.5B-instruct-Q4_K_M-GGUF

Sentence Similarity • Updated Jul 15, 2024 • 22

niancheng/gte-Qwen2-7B-instruct-Q4_K_M-GGUF

Sentence Similarity • Updated Jul 15, 2024 • 15

ichi-kom/all-MiniLM-L6-v2-Q6_K-GGUF

Sentence Similarity • Updated Jul 15, 2024 • 4

mxs980/b1ade-embed-Q8_0-GGUF

Updated Jul 15, 2024 • 4

aifeifei798/Phi-3-song-lyrics-1.1-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 23 • 1

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • Updated Jul 15, 2024 • 64 • 2

NikolayKozloff/h2o-danube3-4b-base-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 3 • 2

xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF

Updated Aug 28, 2024 • 66 • 3

NikolayKozloff/h2o-danube3-500m-base-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 3 • 2

PatronusAI/Llama-3-Patronus-Lynx-70B-Instruct-Q4_K_M-GGUF

Updated Jul 17, 2024 • 19

clarkguilty/cosmosage-v3-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 6

clarkguilty/cosmosage-v3-Q6_K-GGUF

Text Generation • Updated Jul 15, 2024

VAIBHAV22334455/NOVA-3B.v2-Q8_0-GGUF

Updated Jul 15, 2024 • 6

Lancer1408/LLaMa-3-Stheno-v3.2-15B-Q5_K_M-GGUF

Updated Jul 15, 2024 • 2