metadata
base_model:
- Qwen/Qwen2.5-Math-72B
GGUF quants of nvidia/AceMath-72B-Instruct
Using llama.cpp b4682 (commit 0893e0114e934bdd0eba0ff69d9ef8c59343cbc3)
The importance matrix was generated with groups_merged-enhancedV3.txt by InferenceIllusionist (later renamed calibration_datav3.txt), an edited version of kalomaze's original groups_merged.txt.
All quants were generated/calibrated with the imatrix, including the K quants.