Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
SAXON-0-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
SAXON-0-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
5223270fd4ab41325d1050c8cdacd39adfdd1acf9b27474aa91499cd926a6e0f
b37c60f
verified
7 days ago
.gitattributes
1.85 kB
5223270fd4ab41325d1050c8cdacd39adfdd1acf9b27474aa91499cd926a6e0f
7 days ago
README.md
2.82 kB
5223270fd4ab41325d1050c8cdacd39adfdd1acf9b27474aa91499cd926a6e0f
7 days ago
SAXON-0-GGUF_imatrix.dat
4.99 MB
LFS
5223270fd4ab41325d1050c8cdacd39adfdd1acf9b27474aa91499cd926a6e0f
7 days ago
SAXON-0.Q5_K_M.gguf
5.73 GB
LFS
8d60db27dfbd4fad212bb4a64e3abbbbf461bb408dc5f989588b97f2e19f9ffe
7 days ago
SAXON-0.Q5_K_S.gguf
5.6 GB
LFS
9c49f63f3191b158505c9b156aa0f7c6f8414666eaa1515d5224742208a33f2d
7 days ago
SAXON-0.Q6_K.gguf
6.6 GB
LFS
9fea879821c91625b7e5fae72bd39fceb0f2af63c0ec130c72502261b136de19
7 days ago
SAXON-0.Q8_0.gguf
8.54 GB
LFS
9f151277eb0ab78218f1fbfdc173ae941caede36add293e476b86f2b6954e0ab
7 days ago
SAXON-0.fp16.gguf
16.1 GB
LFS
cea2a64b451279003281e80c4f0c87a0e8a0c0930530b4174550877efea141e2
7 days ago
