Updating README - LM development
Browse files
README.md
CHANGED
@@ -12,10 +12,9 @@ license: apache-2.0
|
|
12 |
|
13 |
# **Pico: A Lightweight Framework for Studying Language Model Learning Dynamics**
|
14 |
|
15 |
-
Welcome to
|
16 |
|
17 |
-
|
18 |
-
2. **Analyzing** these models’ learning behaviors using checkpoints enriched with activations, gradients, and evaluation metrics.
|
19 |
|
20 |
For full documentation and code, visit our two main repositories:
|
21 |
- [**pico-train**](https://github.com/pico-lm/pico-train): Minimalist training framework for language models.
|
|
|
12 |
|
13 |
# **Pico: A Lightweight Framework for Studying Language Model Learning Dynamics**
|
14 |
|
15 |
+
Welcome to Pico LM 👋, a research initiative dedicated to demystifying language model learning.
|
16 |
|
17 |
+
We create two complementary frameworks (pico-train and pico-analyze) for training and analyzing small to mid-scale language models (1M–1B parameters). Our mission is to provide a transparent, research-oriented workflow that illuminates how these models learn.
|
|
|
18 |
|
19 |
For full documentation and code, visit our two main repositories:
|
20 |
- [**pico-train**](https://github.com/pico-lm/pico-train): Minimalist training framework for language models.
|