Vishwas1
/

hummingbird_Llama_distill_float32

Model card Files Files and versions Community

hummingbird_Llama_distill_float32

1 contributor

History: 3 commits

Vishwas1's picture

Training finished (float32, Xavier Init), epochs=3, lr=1e-07, clip=1, batch_size=4, loss=8.6898, perplexity=nan

491e7bc verified about 1 month ago

.gitattributes

1.52 kB

initial commit about 1 month ago
README.md

24 Bytes

initial commit about 1 month ago
special_tokens_map.json

437 Bytes

Training finished (float32, no LayerNorm), epochs=3, lr=1e-07, clip=1, batch_size=4, loss=9.0133, perplexity=nan about 1 month ago
student_model.pth

91 MB
LFS

Training finished (float32, Xavier Init), epochs=3, lr=1e-07, clip=1, batch_size=4, loss=8.6898, perplexity=nan about 1 month ago
tokenizer.model

500 kB
LFS

Training finished (float32, no LayerNorm), epochs=3, lr=1e-07, clip=1, batch_size=4, loss=9.0133, perplexity=nan about 1 month ago
tokenizer_config.json

1.02 kB

Training finished (float32, no LayerNorm), epochs=3, lr=1e-07, clip=1, batch_size=4, loss=9.0133, perplexity=nan about 1 month ago