---
license: cc-by-nc-sa-4.0
language:
- mk
- en
tags:
- axolotl
- exl2
---

# MKLLM-7B-Instruct-exl2

EXL2 quants of [trajkovnikola/MKLLM-7B-Instruct](https://huggingface.co/trajkovnikola/MKLLM-7B-Instruct)

<b>The "main" branch only contains the measurement.json (which can be used for further conversions), download one of the other branches for the model:</b>

[6.5 bits per weight with 6 lm_head bits](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/tree/6.5bpw-h6)  
[5.0 bits per weight with 6 lm_head bits](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/tree/5.0bpw-h6)  
[4.25 bits per weight with 6 lm_head bits](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/tree/4.25bpw-h6)  
[3.5 bits per weight with 6 lm_head bits](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/tree/3.5bpw-h6)

[measurement.json](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/blob/main/measurement.json)


## Download instructions

With git:

```shell
git clone --single-branch --branch 5.0bpw-h6 https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2 MKLLM-7B-Instruct-exl2-5.0bpw-h6
```

With huggingface hub:

To download a specific branch, use the `--revision` parameter.

```shell
huggingface-cli download martinkozle/MKLLM-7B-Instruct-exl2 --revision 5.0bpw-h6 --local-dir MKLLM-7B-Instruct-exl2-5.0bpw-h6 --local-dir-use-symlinks False
```