OpenMOSE
/

PRWKV-7-Phi-4-Instruct-Preview-v0.1

Model card Files Files and versions Community

OpenMOSE commited on Mar 15

Commit

65cea44

·

1 Parent(s): 646f063

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -71,8 +71,9 @@ curl http://127.0.0.1:9000/loadmodel -X POST -H "Content-Type: application/json"
 ## Training Infrastructure
 - Hardware: Single AMD MI300X GPU
 - Training Duration: 3 days(Stage1,2)
-- Stage1 180MToken
-- Stage2 160MToken (in training)
 - Stage3 1GToken(TBD)
 ## Acknowledgements

 ## Training Infrastructure
 - Hardware: Single AMD MI300X GPU
 - Training Duration: 3 days(Stage1,2)
+- Stage1 180MToken (LR1e-4)
+- Stage2 160MToken (Temperature 1.0KD LR5e-6)
+- Stage2.5 TBD (Temperature 2.0KD LR3e-5)
 - Stage3 1GToken(TBD)
 ## Acknowledgements