rdiehlmartinez commited on
Commit
1e7592f
·
verified ·
1 Parent(s): bc22fbb

Updating README - LM development

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -12,10 +12,9 @@ license: apache-2.0
12
 
13
  # **Pico: A Lightweight Framework for Studying Language Model Learning Dynamics**
14
 
15
- Welcome to the **pico-lm** organization on Hugging Face! Pico is designed to **demystify** how language models learn by:
16
 
17
- 1. **Training** a family of language models at different scales using a transparent, minimally opinionated codebase.
18
- 2. **Analyzing** these models’ learning behaviors using checkpoints enriched with activations, gradients, and evaluation metrics.
19
 
20
  For full documentation and code, visit our two main repositories:
21
  - [**pico-train**](https://github.com/pico-lm/pico-train): Minimalist training framework for language models.
 
12
 
13
  # **Pico: A Lightweight Framework for Studying Language Model Learning Dynamics**
14
 
15
+ Welcome to Pico LM 👋, a research initiative dedicated to demystifying language model learning.
16
 
17
+ We create two complementary frameworks (pico-train and pico-analyze) for training and analyzing small to mid-scale language models (1M–1B parameters). Our mission is to provide a transparent, research-oriented workflow that illuminates how these models learn.
 
18
 
19
  For full documentation and code, visit our two main repositories:
20
  - [**pico-train**](https://github.com/pico-lm/pico-train): Minimalist training framework for language models.