|
--- |
|
metrics: |
|
- code_eval |
|
library_name: transformers |
|
tags: |
|
- code |
|
model-index: |
|
- name: Tiny-StarCoder-Py |
|
results: |
|
- task: |
|
type: text-generation |
|
dataset: |
|
type: openai_humaneval |
|
name: HumanEval |
|
metrics: |
|
- name: pass@1 |
|
type: pass@1 |
|
value: 7.84% |
|
verified: false |
|
--- |
|
159M model with the same architecture and tokenizer as StarCoder (8k context length) pre-trained on 100B tokens of Python from StarCoderData (~6 epochs) |
|
|
|
Full training arguments + loss at: https://wandb.ai/loubnabnl/tiny_starcoder/runs/qogbxkgy/overview?workspace=user-loubnabnl |
|
|
|
Pass@1: 7.84% |
