Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-7B-Instruct-GGUF
like
9
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Qwen2.5-7B-Instruct-GGUF
1 contributor
History:
17 commits
MaziyarPanahi
fa1f035e9d865502b652dfd613f1a9026ac86b583c6e4a52f57b9a4b69ba6de1
2ccd20c
verified
6 months ago
.gitattributes
2.67 kB
fa1f035e9d865502b652dfd613f1a9026ac86b583c6e4a52f57b9a4b69ba6de1
6 months ago
Qwen2.5-7B-Instruct-GGUF_imatrix.dat
4.54 MB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
6 months ago
Qwen2.5-7B-Instruct.IQ1_M.gguf
2.04 GB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
6 months ago
Qwen2.5-7B-Instruct.IQ1_S.gguf
1.9 GB
LFS
fa1f035e9d865502b652dfd613f1a9026ac86b583c6e4a52f57b9a4b69ba6de1
6 months ago
Qwen2.5-7B-Instruct.IQ2_XS.gguf
2.47 GB
LFS
44c6a0b8f78825a3147de8de592c166ba11e8cc6f8c922b2da4449fed4a71e57
6 months ago
Qwen2.5-7B-Instruct.IQ3_XS.gguf
3.35 GB
LFS
d59be69841e6cb9d31e8cc0ed148704e163918c6724d4493e7bcdc9cf2beb8b8
6 months ago
Qwen2.5-7B-Instruct.IQ4_XS.gguf
4.22 GB
LFS
06292debb4788bcf595f31aac201dff738b4736fcead2dcfef54ca58f485b2a1
6 months ago
Qwen2.5-7B-Instruct.Q2_K.gguf
3.02 GB
LFS
cff37708b2fd6e0282a61b2bb2a53c6d799c97f6cd1ae9116beba2c3ec3506f5
6 months ago
Qwen2.5-7B-Instruct.Q3_K_L.gguf
4.09 GB
LFS
d3cedffa67593fb5c39b5de428aef59e3407ef79af5850a02c9b6fab593be9ff
6 months ago
Qwen2.5-7B-Instruct.Q3_K_M.gguf
3.81 GB
LFS
ef1f9f7b91c20401f0fa9926c0d070325576fb134d43d17ac8043f649421b82d
6 months ago
Qwen2.5-7B-Instruct.Q3_K_S.gguf
3.49 GB
LFS
42d222e934c07e4e9b99c5202d7027463a767f8b52fb34908150705193616d21
6 months ago
Qwen2.5-7B-Instruct.Q4_K_M.gguf
4.68 GB
LFS
5e18745403b6d85559abb00cd90cc5525272db9835c11e441993172f944b7cf4
6 months ago
Qwen2.5-7B-Instruct.Q4_K_S.gguf
4.46 GB
LFS
e2bff8025cc1cd870f3935ce13499af9bf65140e804dbaf54cb3ee728fe604de
6 months ago
Qwen2.5-7B-Instruct.Q5_K_M.gguf
5.44 GB
LFS
11629bdf00bb979d8b5aaf66e8a6df9ea6466deda0a6692360c0ecce62a65d1c
6 months ago
Qwen2.5-7B-Instruct.Q5_K_S.gguf
5.32 GB
LFS
b7e9438b2d089353824b15952288cfd5c5b05bde07a550e06e89082374915120
6 months ago
Qwen2.5-7B-Instruct.Q6_K.gguf
6.25 GB
LFS
c71beb8bc1d06cead670b483996c9793598fef3563339e9039e8f375b34b8c1b
6 months ago
Qwen2.5-7B-Instruct.Q8_0.gguf
8.1 GB
LFS
7360910b5804c55d26b5a1a05025fc72eacca4baab2d090c79c368c83ef757b2
6 months ago
Qwen2.5-7B-Instruct.fp16.gguf
15.2 GB
LFS
5d817d19a1d0a84d182543b1950dbd10d66c988ea8fe25646eeca46a053f353b
6 months ago
README.md
2.94 kB
fa1f035e9d865502b652dfd613f1a9026ac86b583c6e4a52f57b9a4b69ba6de1
6 months ago
