Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

EXL2 quants for Aqueducts 18B - https://huggingface.co/MarsupialAI/Aqueducts-18B

Downloads last month
21
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for Clevyby/Aqueducts4.5

Quantized
(26)
this model