|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
base_model: |
|
- PygmalionAI/Pygmalion-3-12B |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
# Eleusis-12B ExLlamaV2 |
|
|
|
This repo contains the ExLlamaV2 quants of the [Pygmalion-3-12B](https://huggingface.co/PygmalionAI/Pygmalion-3-12B) model. |
|
The main branch only contains the `measurement.json` file, to produce your own quants of the model with a different bpw. |
|
You can find the pre-quanted checkpoints in the following branches: |
|
|
|
- [3.0bpw](https://huggingface.co/PygmalionAI/Pygmalion-3-12B-EXL2/tree/3.0bpw) |
|
- [4.0bpw](https://huggingface.co/PygmalionAI/Pygmalion-3-12B-EXL2/tree/4.0bpw) |
|
- [5.0bpw](https://huggingface.co/PygmalionAI/Pygmalion-3-12B-EXL2/tree/5.0bpw) |
|
- [6.0bpw](https://huggingface.co/PygmalionAI/Pygmalion-3-12B-EXL2/tree/6.0bpw) |
|
- [7.0bpw](https://huggingface.co/PygmalionAI/Pygmalion-3-12B-EXL2/tree/7.0bpw) |
|
- [8.0bpw](https://huggingface.co/PygmalionAI/Pygmalion-3-12B-EXL2/tree/8.0bpw) |
