wenqiglantz commited on
Commit
03a1138
·
1 Parent(s): 735e134

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -14,9 +14,11 @@ quantized_by: wenqiglantz
14
  ---
15
 
16
  # Mistral 7B Instruct v0.2 - GGUF
17
- - Model creator: [Mistral AI_](https://huggingface.co/mistralai)
18
- - Original model: [Mistral 7B Instruct v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
19
 
 
 
 
 
20
  <!-- description start -->
21
  ## Description
22
 
 
14
  ---
15
 
16
  # Mistral 7B Instruct v0.2 - GGUF
 
 
17
 
18
+ This is a quantized model for `mistralai/Mistral-7B-Instruct-v0.2`. Two quantization methods were used:
19
+ - Q5_K_M: 5-bit, preserves most of the model's performance
20
+ - Q4_K_M: 4-bit, smaller footprints and saves more memory
21
+
22
  <!-- description start -->
23
  ## Description
24