Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,7 @@ PRWKV-7-Phi-4-Instruct is a large language model based on the RNN-based RWKV-x07
|
|
| 11 |
|
| 12 |
- **Architecture**: RWKV-x070 "Goose"(RNN-based)
|
| 13 |
- **Parameters**: 16.3 billion
|
|
|
|
| 14 |
- **Base Model**: Derived from Microsoft Phi-4 14B
|
| 15 |
- **Development Stage**: Experimental preview (no performance guarantees)
|
| 16 |
- **License**: Apache 2.0
|
|
|
|
| 11 |
|
| 12 |
- **Architecture**: RWKV-x070 "Goose"(RNN-based)
|
| 13 |
- **Parameters**: 16.3 billion
|
| 14 |
+
- **Training Context Window**: 8192(Stage1=2560, Stage2=8192, Stage3=12288)
|
| 15 |
- **Base Model**: Derived from Microsoft Phi-4 14B
|
| 16 |
- **Development Stage**: Experimental preview (no performance guarantees)
|
| 17 |
- **License**: Apache 2.0
|