redponike's picture
Update README.md
e11ca0c verified
metadata
base_model:
  - Qwen/Qwen2.5-Math-72B

GGUF quants of nvidia/AceMath-72B-Instruct

Paper link on arXiv

Using llama.cpp b4682 (commit 0893e0114e934bdd0eba0ff69d9ef8c59343cbc3)

The importance matrix was generated with groups_merged-enhancedV3.txt by InferenceIllusionist (later renamed calibration_datav3.txt), an edited version of kalomaze's original groups_merged.txt.

All quants were generated/calibrated with the imatrix, including the K quants.