Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,964

Full-text search

Active filters: llama-cpp

JustData/Prima-LelantaclesV7-experimental-7b-Q8_0-GGUF

Updated May 27, 2024 • 2

Ransss/Foredoomed-9B-Q8_0-GGUF

Updated May 7, 2024 • 1

NikolayKozloff/granite-20b-code-instruct-Q4_0-GGUF

Text Generation • Updated May 7, 2024 • 5 • 2

NikolayKozloff/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 7, 2024 • 8 • 2

NikolayKozloff/granite-20b-code-base-Q3_K_L-GGUF

Text Generation • Updated May 7, 2024 • 4 • 1

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q8_0-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 5

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q4_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 23

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 8

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q2_K-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 1

noxinc/gemma-portuguese-tom-cat-2b-it-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 12

noxinc/gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 10

noxinc/Mistral-portuguese-luana-7b-chat-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 6

noxinc/Mistral-portuguese-luana-7b-Mathematics-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 1 • 1

noxinc/Mistral-portuguese-luana-7b-mental-health-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 9 • 2

noxinc/Mistral-portuguese-luana-7b-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024

YorkieOH10/starcoder2-15b-instruct-v0.1-Q8_0-GGUF

Text Generation • Updated May 7, 2024 • 6

YorkieOH10/Llama-3-8B-Instruct-Coder-v2-Q8_0-GGUF

Updated May 7, 2024 • 3

YorkieOH10/CodeQwen1.5-7B-Chat-Q8_0-GGUF

Text Generation • Updated May 7, 2024 • 3

YorkieOH10/GPT-NeoX-20B-Erebus-Q8_0-GGUF

Updated May 7, 2024 • 286 • 4

bibidentuhanoi/BMO-7B-Instruct-Mistral-Q6_K-GGUF

Updated May 7, 2024 • 6

Zetaphor/kappa-3-phi-abliterated-Q2_K-GGUF

Updated May 7, 2024 • 1

aablski/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated May 7, 2024

Testasfsd/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 7, 2024 • 3

MoMonir/Mistroll-7B-v2.2-GGUF

Text Generation • Updated May 7, 2024

andreass123/Synatra-7B-v0.3-Translation-Q4_K_M-GGUF

Updated May 8, 2024 • 1

wwe180/llama-3-neural-chat-v2.2-8B-Q6_K-GGUF

Text Generation • Updated May 8, 2024

yc/Octopus-v2-Q4_K_M-GGUF

Updated May 8, 2024 • 4 • 1

yews1234/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated May 8, 2024 • 1

yews1234/llama-2-koen-13b-Q4_K_M-GGUF

Text Generation • Updated May 8, 2024 • 7

SourPineapple/Llama-3-8B-Instruct-abliterated-Q5_K_M-GGUF

Updated May 8, 2024 • 1