1 contributor

History: 26 commits

mradermacher

uploaded from leia

4586ef2 verified 3 months ago

.gitattributes

3.21 kB

uploaded from leia 3 months ago
README.md

243 Bytes

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ1_M.gguf

2 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ1_S.gguf

1.84 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ2_M.gguf
2.84 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ2_S.gguf
2.62 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ2_XS.gguf
2.5 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ2_XXS.gguf
2.27 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ3_M.gguf
3.74 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ3_XS.gguf
3.43 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ3_XXS.gguf
3.2 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-IQ4_XS.gguf
4.43 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q2_K.gguf
3.1 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q3_K_L.gguf
4.35 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q3_K_M.gguf
4 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q3_K_S.gguf
3.59 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q4_0.gguf
4.67 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q4_0_4_4.gguf
4.65 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q4_0_4_8.gguf
4.65 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q4_K_M.gguf
4.94 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q4_K_S.gguf
4.69 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q5_K_M.gguf
5.8 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q5_K_S.gguf
5.65 GB
LFS

uploaded from leia 3 months ago
granite-3.0-8b-instruct.i1-Q6_K.gguf
6.71 GB
LFS

uploaded from leia 3 months ago
imatrix.dat

5.99 MB
LFS

uploaded from leia 3 months ago