Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
datatab
/
YugoGPT-Quantized-GGUF
like
2
Transformers
GGUF
Serbian
mistral
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
efa4de9
YugoGPT-Quantized-GGUF
1 contributor
History:
55 commits
datatab
q4_k_s: Uses Q4_K for all tensors
efa4de9
verified
about 1 year ago
.gitattributes
3.94 kB
q4_k_s: Uses Q4_K for all tensors
about 1 year ago
README.md
Safe
3.42 kB
Update README.md
about 1 year ago
YugoGPT-Quantized-GGUF.Q3_K_XS.gguf
Safe
3 GB
LFS
q3_k_xs" : "3-bit extra small quantization
about 1 year ago
YugoGPT-Quantized-GGUF.Q5_0.gguf
Safe
5 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q5_0.gguf to YugoGPT-Quantized-GGUF.Q5_0.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q5_K_M.gguf
Safe
5.13 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q5_K_M.gguf to YugoGPT-Quantized-GGUF.Q5_K_M.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q5_K_S.gguf
Safe
5 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q5_K_S.gguf to YugoGPT-Quantized-GGUF.Q5_K_S.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q6_K.gguf
Safe
5.94 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q6_K.gguf to YugoGPT-Quantized-GGUF.Q6_K.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q8_0.gguf
Safe
7.7 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q8_0.gguf to YugoGPT-Quantized-GGUF.Q8_0.gguf
about 1 year ago
YugoGPT-Quantized.GGUF.Q2_K.gguf
Safe
2.72 GB
LFS
q2_k: Uses Q4_K for the attention.vw and feed_forward.w2 tensors, Q2_K for the other tensors.
about 1 year ago
YugoGPT-Quantized.GGUF.Q3_K_L.gguf
Safe
3.82 GB
LFS
q3_k_l: Uses Q5_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K
about 1 year ago
YugoGPT-Quantized.GGUF.Q3_K_M.gguf
Safe
3.52 GB
LFS
q3_k_m: Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K
about 1 year ago
YugoGPT-Quantized.GGUF.Q3_K_S.gguf
Safe
3.16 GB
LFS
q3_k_s: Uses Q3_K for all tensors
about 1 year ago
YugoGPT-Quantized.GGUF.Q4_0.gguf
Safe
4.11 GB
LFS
q4_0: Original quant method, 4-bit.
about 1 year ago
YugoGPT-Quantized.GGUF.Q4_K_M.gguf
Safe
4.37 GB
LFS
q4_k_m: Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q4_K
about 1 year ago
YugoGPT-Quantized.GGUF.Q4_K_S.gguf
Safe
4.14 GB
LFS
q4_k_s: Uses Q4_K for all tensors
about 1 year ago
config.json
Safe
31 Bytes
Create config.json
about 1 year ago
