README.md

---
license: apache-2.0
language:
- en
base_model:
- PygmalionAI/Eleusis-12B
pipeline_tag: text-generation
---

# Eleusis-12B ExLlamaV2

This repo contains the ExLlamaV2 quants of the [Eleusis-12B](https://huggingface.co/PygmalionAI/Eleusis-12B) model.
The main branch only contains the `measurement.json` file, to produce your own quants of the model with a different bpw.
You can find the pre-quanted checkpoints in the following branches:

- [3.0bpw](https://huggingface.co/PygmalionAI/Eleusis-12B-EXL2/tree/3.0bpw)
- [4.0bpw](https://huggingface.co/PygmalionAI/Eleusis-12B-EXL2/tree/4.0bpw)
- [5.0bpw](https://huggingface.co/PygmalionAI/Eleusis-12B-EXL2/tree/5.0bpw)
- [6.0bpw](https://huggingface.co/PygmalionAI/Eleusis-12B-EXL2/tree/6.0bpw)
- [7.0bpw](https://huggingface.co/PygmalionAI/Eleusis-12B-EXL2/tree/7.0bpw)
- [8.0bpw](https://huggingface.co/PygmalionAI/Eleusis-12B-EXL2/tree/8.0bpw)