--- base_model: - Nitral-Archive/Falcon3-10B-Instruct-ChatMLified - Nitral-Archive/Falcon3-10B-Instruct-abliterated-ChatMLified library_name: transformers tags: - mergekit - merge --- # The following models were included in the merge: * [Nitral-Archive/Falcon3-10B-Instruct-ChatMLified](https://huggingface.co/Nitral-Archive/Falcon3-10B-Instruct-ChatMLified) * [Nitral-Archive/Falcon3-10B-Instruct-abliterated-ChatMLified](https://huggingface.co/Nitral-Archive/Falcon3-10B-Instruct-abliterated-ChatMLified) ### The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: Nitral-Archive/Falcon3-10B-Instruct-ChatMLified layer_range: [0, 40] - model: Nitral-Archive/Falcon3-10B-Instruct-abliterated-ChatMLified layer_range: [0, 40] merge_method: slerp base_model: Nitral-Archive/Falcon3-10B-Instruct-ChatMLified parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.420 dtype: bfloat16 ```