Qwen2.5-7B-CABS-v0.3: A Merged Model Using a Novel Technique

This model is a merged version of Qwen/Qwen2.5-7B-Instruct utilizing a novel model merging technique to optimize performance while maintaining robustness across tasks.

Official Performance

This model has been officially evaluated on open_llm_leaderboard, achieving the following results:

IFEVAL BBH MATH GPQA MUSR MMLU-PRO AVG
75.70 35.96 49.32 7.61 15.24 37.80 36.94

As of February 19, 2025, this model ranks 1st among all 7B and smaller models on open_llm_leaderboard.

For the latest and complete leaderboard rankings, please refer to the open_llm_leaderboard.

Recipe Coming Soon

We will release details on the merging technique and methodology soon, Stay tuned for updates! ๐Ÿš€

Downloads last month
107
Safetensors
Model size
7.62B params
Tensor type
BF16
ยท
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for gz987/qwen2.5-7b-cabs-v0.3

Base model

Qwen/Qwen2.5-7B
Finetuned
(496)
this model
Merges
1 model