5fa1a76
1
For some quantization methods, they may require "pre-quantizing" the models through data calibration (e.g., AWQ).