Llama
Collection
Meta-based models
•
945 items
•
Updated
•
1
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Passthrough merge method using nbeerbower/llama3.1-cc-8B + mpasila/Llama-3.1-Literotica-LoRA-8B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
base_model: nbeerbower/llama3.1-cc-8B+mpasila/Llama-3.1-Literotica-LoRA-8B
dtype: bfloat16
merge_method: passthrough
models:
- model: nbeerbower/llama3.1-cc-8B+mpasila/Llama-3.1-Literotica-LoRA-8B
tokenizer_source: unsloth/Meta-Llama-3.1-8B
Detailed results can be found here
Metric | Value |
---|---|
Avg. | 12.72 |
IFEval (0-Shot) | 29.93 |
BBH (3-Shot) | 13.87 |
MATH Lvl 5 (4-Shot) | 0.30 |
GPQA (0-shot) | 3.69 |
MuSR (0-shot) | 6.24 |
MMLU-PRO (5-shot) | 22.27 |