Producing <0x0A><0x0A> in outputs
#1
by
Nitral-AI
- opened
Seems to be affecting only the gguf variants from what i can see. Double checked the exl2 quants and fp16 and cannot reproduce on either.
hey, sorry to hear.. i still need to setup testing..
I never know which "vocab-type" to choose, docs seem a bit unclear.. uploading a new release using "spm" right now
// Or it might be related to this issue/PR: https://github.com/ggerganov/llama.cpp/pull/5341
No worries, and thanks for doing it at all my dude! I just didnt want anyone to come complaining about it to you. Grabbing the reupload to test now.