Can anyone extend Stheno to 10-14B?
#5
by
Varkoyote
- opened
If possible, I would really appreciate a version of Stheno with more parameters. The only problem I've faced with this model is a loss of coherence for long stories, otherwise it's nearly perfect. If anyone could make a bigger version that would allow it to be slightly smarter (or less hallucinating), that would be the dream... thanks!
Nevermind, I just realized there is already a 15B version to try!
Got the same problem, 8k context is cool for short dialoques, but longer rpg action does need more power