Tiny Stories in Unity 6 with Inference Engine

This is the Tiny Stories model running in Unity 6 with Inference Engine. Tiny Stories is a Large Language Model that was trained on children's stories and can create stories based on the first couple of sentences.

How to Use

Create a new scene in Unity 6;
Install com.unity.ai.inference from the package manager;
Install com.unity.nuget.newtonsoft-json from the package manager;
Add the RunTinyStories.cs script to the Main Camera;
Drag the tinystories.onnx asset from the models folder into the Model Asset field;
Drag the vocab.json asset from the data folder into the Vocab Asset field;
Drag the merges.txt asset from the data folder into the Merges Asset field;

Preview

Enter play mode. If working correctly the predicted text will be logged to the console.

Inference Engine

Inference Engine is a neural network inference library for Unity. Find out more here.

Disclaimer

The model was trained on children's stories so very unlikely to produce undesirable text. As an extra precaution, we removed a few tokens from vocab.json that might not be suitable for younger audiences. The original json can be found on the Tiny Stories original page.