--- base_model: - Aleteian/Instrumentality-2-MN-12B-RP - Aleteian/Saiga-Unleashed - Moraliane/NekoMix-12B - PygmalionAI/Pygmalion-3-12B - PocketDoc/Dans-DangerousWinds-V1.1.0-12b - Aleteian/On-the-Strange-Lands-MN-12B - anthracite-org/magnum-v2.5-12b-kto - Aleteian/Pathfinder-RP-12B-RU library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Aleteian/Saiga-Unleashed](https://huggingface.co/Aleteian/Saiga-Unleashed) as a base. ### Models Merged The following models were included in the merge: * [Aleteian/Instrumentality-2-MN-12B-RP](https://huggingface.co/Aleteian/Instrumentality-2-MN-12B-RP) * [Moraliane/NekoMix-12B](https://huggingface.co/Moraliane/NekoMix-12B) * [PygmalionAI/Pygmalion-3-12B](https://huggingface.co/PygmalionAI/Pygmalion-3-12B) * [PocketDoc/Dans-DangerousWinds-V1.1.0-12b](https://huggingface.co/PocketDoc/Dans-DangerousWinds-V1.1.0-12b) * [Aleteian/On-the-Strange-Lands-MN-12B](https://huggingface.co/Aleteian/On-the-Strange-Lands-MN-12B) * [anthracite-org/magnum-v2.5-12b-kto](https://huggingface.co/anthracite-org/magnum-v2.5-12b-kto) * [Aleteian/Pathfinder-RP-12B-RU](https://huggingface.co/Aleteian/Pathfinder-RP-12B-RU) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: Moraliane/NekoMix-12B - model: PygmalionAI/Pygmalion-3-12B - model: Aleteian/Pathfinder-RP-12B-RU - model: PocketDoc/Dans-DangerousWinds-V1.1.0-12b - model: Aleteian/Instrumentality-2-MN-12B-RP - model: anthracite-org/magnum-v2.5-12b-kto - model: Aleteian/On-the-Strange-Lands-MN-12B merge_method: model_stock base_model: Aleteian/Saiga-Unleashed dtype: bfloat16 tokenizer_source: "union" chat_template: "auto" ```