Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,596

Full-text search

Active filters: llama-cpp

reach-vb/llama-3-8b-Q8_0-GGUF

Updated Apr 22, 2024 • 5

Ransss/L3-TheSpice-8b-v0.1.3-Q8_0-GGUF

Updated Apr 22, 2024 • 6

lkraven/Llama-3-Aplite-Instruct-4x8B-Q6_K-GGUF

Text Generation • Updated Apr 22, 2024 • 8

Bessa/llava-llama-3-8b-v1_1-Q4_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 11

Bessa/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 180 • 1

MoMonir/dolphin-2.9-llama3-8b-GGUF

Updated Apr 25, 2024 • 87 • 1

djward888/llava-llama-3-8b-v1_1-Q6_K-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 2

djward888/llava-llama-3-8b-v1_1-Q8_0-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 15 • 6

djward888/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 19 • 2

djward888/llava-llama-3-8b-v1_1-Q5_K_S-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 1

djward888/llava-llama-3-8b-v1_1-Q5_0-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 3

djward888/llava-llama-3-8b-v1_1-Q4_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 2

djward888/llava-llama-3-8b-v1_1-Q4_K_S-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 3 • 1

djward888/llava-llama-3-8b-v1_1-Q4_0-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 9

djward888/llava-llama-3-8b-v1_1-Q3_K_L-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 3

djward888/llava-llama-3-8b-v1_1-Q3_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 8

djward888/llava-llama-3-8b-v1_1-Q3_K_S-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 13 • 1

djward888/llava-llama-3-8b-v1_1-Q2_K-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 2 • 1

JermemyHaschal/Phigments12-Q6_K-GGUF

Updated Apr 22, 2024 • 5

sosoai/hansoldeco-llama3-70B-8bit-v0.1-Q2_K-GGUF

Updated Apr 23, 2024 • 2

extractio/Llama-3-8B-16K-Q6_K-GGUF

Updated Apr 23, 2024 • 4 • 2

NikolayKozloff/Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT-GGUF

Text Generation • Updated Apr 23, 2024 • 8 • 1

NikolayKozloff/Llama-3-Open-Ko-8B-Instruct-preview-GGUF

Text Generation • Updated Apr 23, 2024 • 1 • 1

jeiku/Kei_Llama3_8B-Q4_K_M-GGUF

Updated Apr 23, 2024 • 8

stormchaser/llava-llama-3-8b-v1_1-Q6_K-GGUF

Image-Text-to-Text • Updated Apr 23, 2024 • 10

hus960/Unsafe-Llama-3-8B-Q4_K_M-GGUF

Updated Apr 23, 2024 • 3

hus960/Llama-3-8b.UNLEASHED-Q4_K_M-GGUF

Text Generation • Updated Apr 23, 2024 • 9 • 2

hus960/Llama-3-SLERP-8B-Q4_K_M-GGUF

Updated Apr 23, 2024 • 3

hus960/openbuddy-qwen1.5-14b-v21.1-32k-Q4_K_M-GGUF

Text Generation • Updated Apr 23, 2024 • 7 • 2

RachidAR/Llama-3-8B-Instruct-Physics-5k-Scar-Q6_K-GGUF

Updated Apr 23, 2024 • 1