Update README.md
Browse files
README.md
CHANGED
@@ -16,8 +16,8 @@ quantized_by: wenqiglantz
|
|
16 |
# Mistral 7B Instruct v0.2 - GGUF
|
17 |
|
18 |
This is a quantized model for `mistralai/Mistral-7B-Instruct-v0.2`. Two quantization methods were used:
|
19 |
-
- Q5_K_M: 5-bit,
|
20 |
-
- Q4_K_M: 4-bit,
|
21 |
|
22 |
<!-- description start -->
|
23 |
## Description
|
|
|
16 |
# Mistral 7B Instruct v0.2 - GGUF
|
17 |
|
18 |
This is a quantized model for `mistralai/Mistral-7B-Instruct-v0.2`. Two quantization methods were used:
|
19 |
+
- Q5_K_M: 5-bit, recommended, low quality loss.
|
20 |
+
- Q4_K_M: 4-bit, recommended, offers balanced quality.
|
21 |
|
22 |
<!-- description start -->
|
23 |
## Description
|