Spaces:
Running
Running
metadata
title: README
emoji: π
colorFrom: red
colorTo: yellow
sdk: static
pinned: true
thumbnail: >-
https://cdn-uploads.huggingface.co/production/uploads/673ab3647afcea17eb4378fd/XKKbARx5zCfggwT6LbCfo.jpeg

SmallDoge
This is the home of the SmallDoge family of small language models, where we release a series of high-quality and ultra-fast small language models. We have released:
- Doge-CheckPoint: A series of checkPoint weights that can continue training on new datasets without spikes of the training.
- Doge-SLM: A series of small language models, including pre-training models, supervised fine-tuning models, and reinforcement learning models.
- [Doge-Downstream-Applications]https://huggingface.co/collections/SmallDoge/doge-downstream-applications-679ce627a0b7820e04ca22bd: A series of small language models for downstream applications.