tokens

#16
by mishavee - opened

Does the system have 2048 tokens? How many words is that approximately?

Is that total for both prompt and completion? Gpt3 seems to allow 4097 tokens total. Is it the same here?

BigScience Workshop org

Technically you can do much more than 2048 of tokens with bloom & bloomz as we use Alibi position embeddings, but havn't done experiments on that yet

what is alibi position embeddings?

what is approximate limit with it?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment