---
base_model:
- sophosympatheia/Evathene-v1.0
- KaraKaraWitch/SteyrCannon-0.2-Qwen2.5-72b
- m8than/banana-2-b-72b
- Qwen/Qwen2.5-72B
- shuttleai/shuttle-3
- ZeusLabs/Chronos-Platinum-72B
library_name: transformers
tags:
- mergekit
- merge

---
# SpaceSatalite

<div>
  <a href="https://www.youtube.com/watch?v=qMQ-y9dHE2k"><img src="https://cdn-uploads.huggingface.co/production/uploads/633e85093a17ab61de8d9073/SXuoacvkkgY1tdagpsdlr.png" style="margin-left:auto;margin-right:auto"></a>
</div>

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Qwen/Qwen2.5-72B](https://huggingface.co/Qwen/Qwen2.5-72B) as a base.

### Models Merged

The following models were included in the merge:
* [sophosympatheia/Evathene-v1.0](https://huggingface.co/sophosympatheia/Evathene-v1.0)
* [KaraKaraWitch/SteyrCannon-0.2-Qwen2.5-72b](https://huggingface.co/KaraKaraWitch/SteyrCannon-0.2-Qwen2.5-72b)
* [m8than/banana-2-b-72b](https://huggingface.co/m8than/banana-2-b-72b)
* [shuttleai/shuttle-3](https://huggingface.co/shuttleai/shuttle-3)
* [ZeusLabs/Chronos-Platinum-72B](https://huggingface.co/ZeusLabs/Chronos-Platinum-72B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: KaraKaraWitch/SteyrCannon-0.2-Qwen2.5-72b
    parameters:
      density: 0.25
      weight: 0.5
  - model: ZeusLabs/Chronos-Platinum-72B
    parameters:
      density: 0.5
      weight: 0.75
  - model: m8than/banana-2-b-72b
    parameters:
      density: 0.65
      weight: 0.40
  - model: shuttleai/shuttle-3
    parameters:
      density: 0.65
      weight: 0.40
  - model: sophosympatheia/Evathene-v1.0
    parameters:
      density: 0.65
      weight: 0.40

merge_method: ties
base_model: Qwen/Qwen2.5-72B
parameters:
  normalize: true
dtype: bfloat16

```