Hugging Face's logo

datatab
/
YugoGPT-Quantized-GGUF

Transformers
GGUF
Serbian
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
datatab commited on
Commit
0cdc79d
·
verified ·
1 Parent(s): ccecd96

q2_k: Uses Q4_K for the attention.vw and feed_forward.w2 tensors, Q2_K for the other tensors.

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. YugoGPT-Quantized-GGUF.Q2_K.gguf → YugoGPT-Quantized.GGUF.Q2_K.gguf +0 -0
.gitattributes CHANGED
@@ -59,3 +59,4 @@ YugoGPT-Quantized-GGUF-unsloth.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
59
  YugoGPT-Quantized-GGUF.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
60
  YugoGPT-Quantized-GGUF-unsloth.Q3_K_XS.gguf filter=lfs diff=lfs merge=lfs -text
61
  YugoGPT-Quantized-GGUF.Q3_K_XS.gguf filter=lfs diff=lfs merge=lfs -text
 
 
59
  YugoGPT-Quantized-GGUF.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
60
  YugoGPT-Quantized-GGUF-unsloth.Q3_K_XS.gguf filter=lfs diff=lfs merge=lfs -text
61
  YugoGPT-Quantized-GGUF.Q3_K_XS.gguf filter=lfs diff=lfs merge=lfs -text
62
+ YugoGPT-Quantized.GGUF.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
YugoGPT-Quantized-GGUF.Q2_K.gguf → YugoGPT-Quantized.GGUF.Q2_K.gguf RENAMED
File without changes