Is QLoRA used to quantize phi-4 to a 4-bit GGUF or another tool?

#4
by harisnaeem - opened

Which method was used to quantize

Okay, I have figured out that it can done through llama-quantize

harisnaeem changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment