1 contributor

History: 26 commits

mradermacher

uploaded from marco

56a48f6 verified 3 months ago

.gitattributes

3.67 kB

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ1_M.gguf

1.35 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ1_S.gguf

1.24 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ2_M.gguf

1.91 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ2_S.gguf

1.77 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ2_XS.gguf

1.68 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ2_XXS.gguf

1.53 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ3_M.gguf

2.5 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ3_XS.gguf

2.31 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ3_XXS.gguf

2.16 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ4_NL.gguf

3.14 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-IQ4_XS.gguf

2.98 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q2_K.gguf

2.08 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q2_K_S.gguf

1.93 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q3_K_L.gguf

2.91 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q3_K_M.gguf

2.68 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q3_K_S.gguf

2.41 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q4_0.gguf

3.14 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q4_1.gguf

3.46 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q4_K_M.gguf

3.32 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q4_K_S.gguf

3.15 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q5_K_M.gguf

3.9 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q5_K_S.gguf

3.8 GB
LFS

uploaded from marco 3 months ago
Mistral-7B-Instruct-v0.2-sliced-24-layer.i1-Q6_K.gguf

4.51 GB
LFS

uploaded from marco 3 months ago
README.md

257 Bytes

uploaded from marco 3 months ago
imatrix.dat

3.74 MB
LFS

uploaded from marco 3 months ago