martinkozle commited on
Commit
4de97cd
·
verified ·
1 Parent(s): af865f4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-sa-4.0
3
+ language:
4
+ - mk
5
+ - en
6
+ tags:
7
+ - axolotl
8
+ ---
9
+
10
+ # MKLLM-7B-Instruct-exl2
11
+
12
+ EXL2 quants of [trajkovnikola/MKLLM-7B-Instruct](https://huggingface.co/trajkovnikola/MKLLM-7B-Instruct)
13
+
14
+ <b>The "main" branch only contains the measurement.json (which can be used for further conversions), download one of the other branches for the model:</b>
15
+
16
+ [4.25 bits per weight with 6 lm_head bits](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/tree/4.25bpw-h6)
17
+ [5.00 bits per weight with 6 lm_head bits](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/tree/5.0bpw-h6)
18
+
19
+ [measurement.json](https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2/blob/main/measurement.json)