Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RichardErkhov
/
TheBlueObserver_-_Qwen2.5-0.5B-Instruct-MLX-gguf
like
0
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
main
TheBlueObserver_-_Qwen2.5-0.5B-Instruct-MLX-gguf
1 contributor
History:
24 commits
RichardErkhov
uploaded readme
0b54f19
verified
about 7 hours ago
.gitattributes
3.13 kB
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.IQ3_M.gguf
343 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.IQ3_S.gguf
339 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.IQ3_XS.gguf
339 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.IQ4_NL.gguf
354 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.IQ4_XS.gguf
351 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q2_K.gguf
339 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q3_K.gguf
355 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q3_K_L.gguf
369 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q3_K_M.gguf
355 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q3_K_S.gguf
338 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q4_0.gguf
352 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q4_1.gguf
375 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q4_K.gguf
398 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q4_K_M.gguf
398 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q4_K_S.gguf
385 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q5_0.gguf
397 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q5_1.gguf
419 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q5_K.gguf
420 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q5_K_M.gguf
420 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q5_K_S.gguf
413 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q6_K.gguf
506 MB
LFS
uploaded model
about 7 hours ago
Qwen2.5-0.5B-Instruct-MLX.Q8_0.gguf
531 MB
LFS
uploaded model
about 7 hours ago
README.md
5.78 kB
uploaded readme
about 7 hours ago