Commit
·
ac4e06b
1
Parent(s):
f61a0db
Update README.md
Browse files
README.md
CHANGED
@@ -49,7 +49,7 @@ A live demonstration of the model can be accessed at [Hugging Face Spaces](https
|
|
49 |
|
50 |
## Work in progress
|
51 |
- [ ] **Improved Pretraining**: A refined version of the existing pretraining approach is under development, aiming to enhance model performance.
|
52 |
-
- [ ] **Extended Model Length**: Utilizing the Rope mechanism
|
53 |
|
54 |
|
55 |
## Taiwanese Culture Examples
|
|
|
49 |
|
50 |
## Work in progress
|
51 |
- [ ] **Improved Pretraining**: A refined version of the existing pretraining approach is under development, aiming to enhance model performance.
|
52 |
+
- [ ] **Extended Model Length**: Utilizing the Rope mechanism, the model's length will be extended from 4k to 8k.
|
53 |
|
54 |
|
55 |
## Taiwanese Culture Examples
|