Update README.md
Browse files
README.md
CHANGED
@@ -119,7 +119,7 @@ model-index:
|
|
119 |
---
|
120 |
|
121 |
## Model Summary
|
122 |
-
PowerLM-3B is a 3B state-of-the-art small language model trained with the Power learning rate scheduler. It is trained on a
|
123 |
Paper: https://arxiv.org/abs/2408.13359
|
124 |
|
125 |
## Usage
|
|
|
119 |
---
|
120 |
|
121 |
## Model Summary
|
122 |
+
PowerLM-3B is a 3B state-of-the-art small language model trained with the Power learning rate scheduler. It is trained on a mix of open-source and proprietary datasets. PowerLM-3B has shown promising results compared to other models in the size categories across various benchmarks, including natural language multi-choices, code generation, and math reasoning.
|
123 |
Paper: https://arxiv.org/abs/2408.13359
|
124 |
|
125 |
## Usage
|