tensorblock
/

Qwen1.5-4B-Chat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen1.5-4B-Chat-GGUF

1 contributor

History: 3 commits

morriszms's picture

Update README.md

6385045 verified 3 months ago

.gitattributes

2.28 kB

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q2_K.gguf

1.62 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q3_K_L.gguf
2.17 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q3_K_M.gguf

2.03 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q3_K_S.gguf

1.86 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q4_0.gguf
2.33 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q4_K_M.gguf
2.46 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q4_K_S.gguf
2.34 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q5_0.gguf
2.78 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q5_K_M.gguf
2.84 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q5_K_S.gguf
2.78 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q6_K.gguf
3.25 GB
LFS

Upload folder using huggingface_hub 3 months ago
Qwen1.5-4B-Chat-Q8_0.gguf
4.2 GB
LFS

Upload folder using huggingface_hub 3 months ago
README.md

4.81 kB

Update README.md 3 months ago