merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

This model was merged using the Passthrough merge method.

The following models were included in the merge:

The following YAML configuration was used to produce this model:

slices:
  - sources:
      - model: TareksLab/Experimental-Base-V1
        layer_range: [0, 80]
merge_method: passthrough
dtype: bfloat16

Safetensors

Model size

70.6B params

Tensor type

BF16

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Base model

Finetuned

(1)

this model

Merges