CAPsMANyo's picture
Create README.md
e365f92 verified
---
base_model:
- FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview
tags:
- awq
- autoawq
---
Quantized with AutoAWQ v0.2.8 using default settings
```
quant_config = {
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM"
}
```