---
license: mit
language:
- en
pipeline_tag: text-generation
widget:
- text: "Bluey:"
  example_title: "Dialogue 1"
- text: "Mom:"
  example_title: "Dialogue 2"  
---

BlueHeeler-10M is a nanoGPT (GPT-2) 6-head x 6-layer x 192-deep model trained on scripts from the children's show Bluey.

`iter 2000: loss 1.2913, time 30647.72ms, mfu 0.05%`