How

#1
by amgadhasan - opened

How did you get the original fp16 parameters from the q5 quant?

probably through some reverse conversion

These aren't the original fp16 params, they're GGUF quant converted 1:1 to PyTorch format. Mostly for testing purposes.

alpindale changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment