Eleusis-12B ExLlamaV2

This repo contains the ExLlamaV2 quants of the Pygmalion-3-12B model. The main branch only contains the measurement.json file, to produce your own quants of the model with a different bpw. You can find the pre-quanted checkpoints in the following branches:

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for PygmalionAI/Pygmalion-3-12B-EXL2

Collection including PygmalionAI/Pygmalion-3-12B-EXL2