Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,945

Full-text search

Active filters: awq

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 832 • 20

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 684k • 3

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 89 • 1

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 267 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 54 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 146 • 1

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 80 • 1

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 294k • 96

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 48.4k • 9

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 206 • 3

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 85k • 46

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 5.68k • 20

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 85.7k • 45

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.59k • 7

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 14.5k • 17

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 18.5k • 14

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • Updated Sep 20, 2024 • 258 • 2

nimishbongale/phi-3-mini-128k-instruct-cuda-awq-int4-block-32-gemm

Updated Sep 28, 2024 • 5 • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 881 • 3

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 13.8k • 22

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated Jan 12 • 18.9k • 6

TechxGenus/Mistral-Large-Instruct-2411-AWQ

Updated Nov 19, 2024 • 789 • 6

andretisch/llava-saiga-8b-awq

Updated Dec 2, 2024 • 43 • 1

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 406k • 23

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated Nov 29, 2024 • 1.02k • 6

OPEA/QwQ-32B-Preview-int4-sym-mixed-awq-inc

Updated Dec 23, 2024 • 42 • 1

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 59.9k • 27

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • Updated Dec 7, 2024 • 89.8k • 1

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 16.9k • 19

lambdalabs/Llama-3.3-70B-Instruct-AWQ-4bit

Updated Dec 10, 2024 • 1.38k • 3