tclf90/qwen2.5-72b-instruct-gptq-int4
Text Generation
•
Updated
•
15
Edit Models filters
Inference Providers
Active filters:
int4
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5
Text Generation
•
Updated
•
920
•
5
jojo1899/Phi-3.5-mini-instruct-ov-int4
Updated
•
6
neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic
Text Generation
•
Updated
•
41
neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16
Text Generation
•
Updated
•
14
ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1
Text Generation
•
Updated
•
86
•
51
ModelCloud/Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1
Text Generation
•
Updated
•
40
•
3
neuralmagic/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
•
Updated
•
184
•
1
neuralmagic/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
•
Updated
•
223
neuralmagic/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
Updated
•
43
neuralmagic/granite-3.1-8b-base-quantized.w4a16
Text Generation
•
Updated
•
39
neuralmagic/Phi-3-vision-128k-instruct-W4A16-G128
Text Generation
•
Updated
•
170
•
1
neuralmagic/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
•
Updated
•
1.64k
neuralmagic/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
•
Updated
•
1.83k
neuralmagic/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
•
Updated
•
10.9k
•
2
neuralmagic/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
•
Updated
•
1.2k
neuralmagic/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text
•
Updated
•
473
neuralmagic/Llama-3.2-11B-Vision-Instruct-quantized.w4a16
Image-Text-to-Text
•
Updated
•
517
context-labs/neuralmagic-llama-3.1-8b-instruct-Q4KM
Text Generation
•
Updated
•
9
tensorblock/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
Updated
•
473
FunAGI/LLaDA-8B-Base-gptqmodel-4bit
Text Generation
•
Updated
•
20
rpanchum/jais-13b-int4-sym-ov
Text Generation
•
Updated
•
8
rpanchum/falcon3-7b-instruct-int4-sym-ov
Text Generation
•
Updated
•
3