metadata
base_model:
- FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview
tags:
- awq
- autoawq
Quantized with AutoAWQ v0.2.8 using default settings
quant_config = {
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM"
}