🪐 SmolLM Collection A series of smol LLMs: 135M, 360M and 1.7B. We release base and Instruct models as well as the training corpus and some WebGPU demos • 12 items • Updated Dec 22, 2024 • 214
Running 666 666 FineWeb: decanting the web for the finest text data at scale 🍷 Generate high-quality web text data for LLM training