Disable bos token

#1
by quantflex - opened

Hello ๐Ÿ™‚,

Lets disable bos as according to line 8 in config.json:

https://huggingface.co/Infinigence/Megrez-3B-Instruct/blob/main/config.json#L8

Thank you

Is this repo active? The bos needs to be disabled to create proper quants (gguf).

Infinigence org

Thanks for reporting this!

ZheeRIKO changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment