Hugging Face's logo

qwp4w3hyb
/
Qwen1.5-32B-Chat-iMat-GGUF

GGUF
English
qwen
chat
Inference Endpoints
conversational
Model card Files Community
1

Here is no IQ3_XXS Quant.

#1
by Cran-May - opened
Discussion
Cran-May

IQ3_XXS is more suitable for 16G RAM device so if you like to create a IQ3_XXS quant?

qwp4w3hyb
 Owner
•
edited Apr 6, 2024

Ohh, that's due to a typo in my quantization script (XSS instead of XXS).
Will do!

Edit:
Done!

qwp4w3hyb changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment