🌊 TinyWave: Compact & Expressive Speech Language Models

TinyWave is a family of efficient 2B-parameter speech language models distilled from the 7B SPIRIT-LM teacher. These models support speech-to-speech and interleaved speech–text generation, optimized for real-time use on commodity hardware.

Built through layer-aligned knowledge distillation, TinyWave models retain 93–97% of their teacher’s performance while using only ⅓ of the parameters — ideal for use in voice agents, assistive technologies, and edge devices.

📖 Read the paper: Efficient Interleaved Speech Modeling through Knowledge Distillation (arXiv:2506.23670)
🌐 Demo & samples: tinywave-landing
💻 Code: github.com/mohammadmahdinoori/TinyWave

🔧 Model Variants