32b, 4k ctx?
#2
by
lucyknada
- opened
is 4k the final context-length planned for this model? or is there more in the works?
I really like what they did with the the whole "fully open source" deal, but the 4k context length is indeed head-scratching. I'd also like to hear a word on this.
self replying, since apparently it was mentioned on twitter but not here, what "very soon" means is another question.