File size: 606 Bytes
3243a70 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
metrics:
- code_eval
library_name: transformers
tags:
- code
model-index:
- name: Tiny-StarCoder-Py
results:
- task:
type: text-generation
dataset:
type: openai_humaneval
name: HumanEval
metrics:
- name: pass@1
type: pass@1
value: 7.84%
verified: false
---
159M model with the same architecture and tokenizer as StarCoder (8k context length) pre-trained on 100B tokens of Python from StarCoderData (~6 epochs)
Full training arguments + loss at: https://wandb.ai/loubnabnl/tiny_starcoder/runs/qogbxkgy/overview?workspace=user-loubnabnl
Pass@1: 7.84% |