Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,455

Full-text search

Active filters: gptq

jakiAJK/granite-3.1-8b-instruct_GPTQ-int4

Text Generation • Updated Jan 21 • 130 • 1

shuyuej/c4ai-command-r-v01-GPTQ

Updated Dec 22, 2024 • 15 • 1

OPEA/deepseek-vl2-int4-sym-gptq-inc

Updated Jan 6 • 439 • 5

ModelCloud/QwQ-32B-Preview-gguf-vortex-v1

Text Generation • Updated Dec 26, 2024 • 121 • 2

kaitchup/QwQ-32B-Preview-AutoRound-GPTQ-2bit

Text Generation • Updated Dec 31, 2024 • 42 • 2

huihui-ai/QVQ-72B-Preview-abliterated-GPTQ-Int4

Image-Text-to-Text • Updated Dec 31, 2024 • 32 • 1

OPEA/DeepSeek-V3-int4-sym-gptq-inc

Updated about 1 month ago • 782 • 17

jakiAJK/microsoft-phi-4_GPTQ-int4

Text Generation • Updated Jan 21 • 754 • 1

Satwik11/Microsoft-phi-4-Instruct-AutoRound-GPTQ-4bit

Updated Jan 10 • 54 • 1

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs128-sym

Text Generation • Updated Jan 9 • 20 • 1

nejumi/phi-4-GPTQ-Int4-calib-ja-1k

Updated Jan 21 • 82 • 3

internlm/internlm3-8b-instruct-gptq-int4

Text Generation • Updated Jan 15 • 256 • 4

ModelCloud/Qwen2.5-0.5B-Instruct-gptqmodel-4bit

Text Generation • Updated Jan 16 • 105 • 1

kaitchup/DeepSeek-R1-Distill-Qwen-7B-AutoRound-GPTQ-4bit

Text Generation • Updated Jan 27 • 176 • 2

kaitchup/DeepSeek-R1-Distill-Llama-8B-AutoRound-GPTQ-4bit

Text Generation • Updated Jan 27 • 467 • 1

kaitchup/DeepSeek-R1-Distill-Qwen-14B-AutoRound-GPTQ-4bit

Text Generation • Updated Jan 27 • 810 • 5

nejumi/DeepSeek-R1-Distill-Qwen-32B-GPTQ-Int4-calib-ja-1k

Updated Jan 22 • 183 • 2

jakiAJK/DeepSeek-R1-Distill-Qwen-1.5B_GPTQ-int4

Text Generation • Updated Jan 22 • 610 • 1

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v1

Text Generation • Updated Jan 24 • 322 • 5

adriabama06/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-8bit

Text Generation • Updated Jan 22 • 147 • 1

avoroshilov/DeepSeek-R1-Distill-Qwen-14B-GPTQ_4bit-128g

Text Generation • Updated Jan 25 • 263 • 1

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2

Text Generation • Updated Jan 24 • 4.5k • 6

kaitchup/Mistral-Small-24B-Instruct-2501-AutoRound-GPTQ-4bit

Updated Feb 4 • 579 • 1

rinna/qwen2.5-bakeneko-32b-instruct-gptq-int8

Text Generation • Updated 29 days ago • 115 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W4A16

Text Generation • Updated 29 days ago • 106 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W8A8

Text Generation • Updated 29 days ago • 56 • 1

ConfidentialMind/Mistral-Small-24B-Instruct-2501_GPTQ_G128_W4A16_MSE

Text Classification • Updated 25 days ago • 290 • 1

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • Updated 27 days ago • 1.11k • 2

123santosh/opt-125m-gptq-4bit

Text Generation • Updated 25 days ago • 24 • 1

hfl/Qwen2.5-VL-3B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated 18 days ago • 372 • 1