wenqiglantz commited on
Commit
599d406
·
verified ·
1 Parent(s): 3daaa6f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -16,8 +16,8 @@ quantized_by: wenqiglantz
16
  # Mistral 7B Instruct v0.2 - GGUF
17
 
18
  This is a quantized model for `mistralai/Mistral-7B-Instruct-v0.2`. Two quantization methods were used:
19
- - Q5_K_M: 5-bit, preserves most of the model's performance
20
- - Q4_K_M: 4-bit, smaller footprints and saves more memory
21
 
22
  <!-- description start -->
23
  ## Description
 
16
  # Mistral 7B Instruct v0.2 - GGUF
17
 
18
  This is a quantized model for `mistralai/Mistral-7B-Instruct-v0.2`. Two quantization methods were used:
19
+ - Q5_K_M: 5-bit, recommended, low quality loss.
20
+ - Q4_K_M: 4-bit, recommended, offers balanced quality.
21
 
22
  <!-- description start -->
23
  ## Description