Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

236

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8, 2024 • 85.3k • 112

QuantFactory/Eximius_Persona_5B-GGUF

Updated 4 days ago • 423 • 2

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 23.3k • 44

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 28 days ago • 10.7k • 32

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 492k • 10

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16, 2024 • 14.5k • 4

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1, 2024 • 121 • 4

spxiong/Llama-3.2-3B-Chinese-Instruct

Text Generation • Updated Nov 11, 2024 • 275 • 4

nvidia/Meta-Llama-3.2-3B-Instruct-ONNX-INT4

Updated Nov 15, 2024 • 7

mkurman/llama-3.2-MEDIT-3B-o1

Text Generation • Updated Jan 7 • 322 • 12

LHCat-AI/Llama-Psychology-3.2B

Text Generation • Updated 14 days ago • 19 • 1

pankajmathur/orca_mini_v9_6_3B-Instruct-GGUF

Updated 19 days ago • 226 • 1

unsloth/Llama-3.2-3B-unsloth-bnb-4bit

Text Generation • Updated 18 days ago • 14.9k • 1

johnnietien/JTR1-Llama32-3b-bestgsm8k-gguf-q4_k_m

Updated 2 days ago • 22 • 1

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8, 2024 • 137 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 829 • 19

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25, 2024 • 734k • 26

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 8 • 1

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated 20 days ago • 215k • 17

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 14

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated Sep 25, 2024 • 4

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25, 2024 • 1.67k • 4

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated Sep 25, 2024 • 1

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8, 2024 • 47 • 5

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25, 2024 • 2.52k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9, 2024 • 1.36k • 2

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 720 • 1

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16, 2024 • 7.48k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 74

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 4 days ago • 14.1k • 2