Update README.md
Browse files
README.md
CHANGED
|
@@ -119,7 +119,7 @@ model-index:
|
|
| 119 |
---
|
| 120 |
|
| 121 |
## Model Summary
|
| 122 |
-
PowerLM-3B is a 3B state-of-the-art small language model trained with the Power learning rate scheduler. It is trained on a
|
| 123 |
Paper: https://arxiv.org/abs/2408.13359
|
| 124 |
|
| 125 |
## Usage
|
|
|
|
| 119 |
---
|
| 120 |
|
| 121 |
## Model Summary
|
| 122 |
+
PowerLM-3B is a 3B state-of-the-art small language model trained with the Power learning rate scheduler. It is trained on a mix of open-source and proprietary datasets. PowerLM-3B has shown promising results compared to other models in the size categories across various benchmarks, including natural language multi-choices, code generation, and math reasoning.
|
| 123 |
Paper: https://arxiv.org/abs/2408.13359
|
| 124 |
|
| 125 |
## Usage
|