base_model: | |
- FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview | |
tags: | |
- awq | |
- autoawq | |
Quantized with AutoAWQ v0.2.8 using default settings | |
``` | |
quant_config = { | |
"zero_point": True, | |
"q_group_size": 128, | |
"w_bit": 4, | |
"version": "GEMM" | |
} | |
``` |