-
-
-
-
-
-
Inference Providers
Active filters:
gptq
QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix
Text Generation
•
Updated
•
159
•
3
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
2B
•
Updated
•
5.7k
•
212
openbmb/MiniCPM-o-2_6-int4
Any-to-Any
•
3B
•
Updated
•
1.87k
•
50
QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
1.37k
•
2
btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit
Text Generation
•
5B
•
Updated
•
868
•
2
tencent/Hunyuan-7B-Instruct-GPTQ-Int4
Text Generation
•
1B
•
Updated
•
17
•
2
TheBloke/WizardLM-13B-V1.0-Uncensored-GPTQ
Text Generation
•
2B
•
Updated
•
1.02k
•
30
Qwen/Qwen-7B-Chat-Int4
Text Generation
•
2B
•
Updated
•
1.85k
•
75
Qwen/Qwen2.5-3B-Instruct-GPTQ-Int4
Text Generation
•
0.7B
•
Updated
•
1.51k
•
3
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
Text Generation
•
2B
•
Updated
•
20.4k
•
26
hfl/Qwen2.5-VL-7B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
3B
•
Updated
•
1.42k
•
4
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation
•
3B
•
Updated
•
4.72k
•
2
btbtyler09/Qwen3-30B-A3B-gptq-8bit
Text Generation
•
9B
•
Updated
•
826
•
3
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
5B
•
Updated
•
31.9k
•
20
Qwen/Qwen3-0.6B-GPTQ-Int8
Text Generation
•
0.3B
•
Updated
•
3.08k
•
8
iqbalamo93/Phi-4-mini-instruct-GPTQ-8bit
Text Generation
•
1B
•
Updated
•
114k
•
1
Intel/DeepSeek-R1-0528-int4-AutoRound
Updated
•
160
•
1
tencent/Hunyuan-A13B-Instruct-GPTQ-Int4
Text Generation
•
11B
•
Updated
•
166k
•
48
QuantTrio/GLM-4.1V-9B-Thinking-GPTQ-Int4-Int8Mix
Text Generation
•
3B
•
Updated
•
6
•
1
jart25/Qwen3-30B-A3B-Instruct-2507-Autoround-Int-8bit-gptq
0.6B
•
Updated
•
9
•
1
jart25/Qwen3-30B-A3B-Thinking-2507-Autoround-Int-4bit-gptq
0.6B
•
Updated
•
15
•
1
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
13
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
14
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
54
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
21
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
14
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
14
•
2
elinas/vicuna-13b-4bit
Text Generation
•
Updated
•
16
•
45
TheBloke/koala-7B-GPTQ
Text Generation
•
1B
•
Updated
•
43
•
31
TheBloke/koala-7B-HF
Text Generation
•
Updated
•
2.04k
•
21