CleverBoi
Collection
CleverBoi is a curated collection of data that emphasizes logic, inference, science, code, math and empathy, and its fine tuned language models.
•
16 items
•
Updated
•
1
CleverBoi
The CleverBoi series is based on models that have been fine tuned on a collection of data sets that emphasize logic, inference, math and coding, also known as the CleverBoi data set.
This model has been fine tuned for 1 epoch on the CleverBoi-Data-20k data set.
Uploaded model
- Developed by: theprint
- License: apache-2.0
- Finetuned from model : unsloth/meta-llama-3.1-8b-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 14.01 |
| IFEval (0-Shot) | 19.61 |
| BBH (3-Shot) | 24.13 |
| MATH Lvl 5 (4-Shot) | 4.46 |
| GPQA (0-shot) | 4.81 |
| MuSR (0-shot) | 6.72 |
| MMLU-PRO (5-shot) | 24.31 |
- Downloads last month
- 200
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Dataset used to train theprint/CleverBoi-Llama-3.1-8B-v2
Collection including theprint/CleverBoi-Llama-3.1-8B-v2
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard19.610
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard24.130
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard4.460
- acc_norm on GPQA (0-shot)Open LLM Leaderboard4.810
- acc_norm on MuSR (0-shot)Open LLM Leaderboard6.720
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard24.310