Should add <bos_id> token with infilling
#11
by
Anditty
- opened
Maybe we should organize the prompt like this: <BOS><PRE> {pre} <SUF>{suf} <MID>
You can use the add_special_tokens = True
to automatically add this