Hugging Face's logo

PygmalionAI
/
Pygmalion-3-12B-EXL2

Text Generation
English
Model card Files Community
Pygmalion-3-12B-EXL2 / README.md
alpindale's picture
alpindale
Create README.md
d350165 verified
preview code
|
raw
history blame contribute delete
934 Bytes
metadata
license: apache-2.0
language:
  - en
base_model:
  - PygmalionAI/Pygmalion-3-12B
pipeline_tag: text-generation

Eleusis-12B ExLlamaV2

This repo contains the ExLlamaV2 quants of the Pygmalion-3-12B model. The main branch only contains the measurement.json file, to produce your own quants of the model with a different bpw. You can find the pre-quanted checkpoints in the following branches: