Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-7B-Instruct-GGUF
like
10
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
2
Use this model
a25e6cc
Qwen2.5-7B-Instruct-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
MaziyarPanahi
06292debb4788bcf595f31aac201dff738b4736fcead2dcfef54ca58f485b2a1
a25e6cc
verified
11 months ago
.gitattributes
1.86 kB
06292debb4788bcf595f31aac201dff738b4736fcead2dcfef54ca58f485b2a1
11 months ago
Qwen2.5-7B-Instruct-GGUF_imatrix.dat
4.54 MB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
11 months ago
Qwen2.5-7B-Instruct.IQ1_M.gguf
Safe
2.04 GB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
11 months ago
Qwen2.5-7B-Instruct.IQ2_XS.gguf
Safe
2.47 GB
LFS
44c6a0b8f78825a3147de8de592c166ba11e8cc6f8c922b2da4449fed4a71e57
11 months ago
Qwen2.5-7B-Instruct.IQ3_XS.gguf
Safe
3.35 GB
LFS
d59be69841e6cb9d31e8cc0ed148704e163918c6724d4493e7bcdc9cf2beb8b8
11 months ago
Qwen2.5-7B-Instruct.IQ4_XS.gguf
Safe
4.22 GB
LFS
06292debb4788bcf595f31aac201dff738b4736fcead2dcfef54ca58f485b2a1
11 months ago
