LayiticDolphinOpus

This is a merge of pre-trained language models created using mergekit.

Notes

Hopping on the merge bandwagon, god save me from these names. Surprisingly this thing kinda works? It can (kinda) do assistant tasks, (kinda) do (E)RP. I still suck at this though

Recommended chat format is ChatML because all the source models use some variation of it, but honestly god knows what it'd work best with

Merge Details

Merge Method

This model was merged using the Model Stock merge method using alpindale/Mistral-7B-v0.2-hf as a base.

Models Merged

The following models were included in the merge:

cognitivecomputations/dolphin-2.8-mistral-7b-v02
l3utterfly/mistral-7b-v0.2-layla-v4
dreamgen/opus-v1.2-7b

Configuration

The following YAML configuration was used to produce this model:

merge_method: model_stock
base_model: alpindale/Mistral-7B-v0.2-hf
models:
    - model: dreamgen/opus-v1.2-7b
    - model: l3utterfly/mistral-7b-v0.2-layla-v4
    - model: cognitivecomputations/dolphin-2.8-mistral-7b-v02