Commit
·
03a1138
1
Parent(s):
735e134
Update README.md
Browse files
README.md
CHANGED
@@ -14,9 +14,11 @@ quantized_by: wenqiglantz
|
|
14 |
---
|
15 |
|
16 |
# Mistral 7B Instruct v0.2 - GGUF
|
17 |
-
- Model creator: [Mistral AI_](https://huggingface.co/mistralai)
|
18 |
-
- Original model: [Mistral 7B Instruct v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
|
19 |
|
|
|
|
|
|
|
|
|
20 |
<!-- description start -->
|
21 |
## Description
|
22 |
|
|
|
14 |
---
|
15 |
|
16 |
# Mistral 7B Instruct v0.2 - GGUF
|
|
|
|
|
17 |
|
18 |
+
This is a quantized model for `mistralai/Mistral-7B-Instruct-v0.2`. Two quantization methods were used:
|
19 |
+
- Q5_K_M: 5-bit, preserves most of the model's performance
|
20 |
+
- Q4_K_M: 4-bit, smaller footprints and saves more memory
|
21 |
+
|
22 |
<!-- description start -->
|
23 |
## Description
|
24 |
|