KoboldAI

community

AI & ML interests

Fiction Models made by the KoboldAI community. All uploaded models are either uploaded by their original finetune authors or with the finetune authors permission. Visit our Discord at https://koboldai.org/discord

Recent Activity

Henk717 updated a model 9 days ago

KoboldAI/LLaMA-3.1-8B-Infinity3M-Kobo

concedo updated a model 20 days ago

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Henk717 updated a Space 29 days ago

KoboldAI/Koboldcpp-Tiefighter

View all activity

KoboldAI's activity

Henk717

updated a model 9 days ago

KoboldAI/LLaMA-3.1-8B-Infinity3M-Kobo

Updated 9 days ago • 387

concedo

updated a model 20 days ago

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Updated 20 days ago • 62.8k • 87

Henk717

updated a Space 29 days ago

Koboldcpp Tiefighter

🦎

concedo

updated a Space 29 days ago

Koboldcpp Tiefighter

🦎

Henk717

updated 2 models about 1 month ago

KoboldAI/Llama-3.1-8B-BookAdventures-GGUF

Updated Jan 4 • 1.59k • 1

KoboldAI/Llama-3.1-8B-BookAdventures

Updated Jan 4 • 65 • 5

elinas

posted an update 5 months ago

Post

2334

We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback!

ZeusLabs/Chronos-Divergence-33B