Ctrl+K

4 contributors

Step... (219001/250000 | Loss: 1.6840890645980835, Acc: 0.6597731709480286): 64%|██████████████ | 159238/250000 [81:41:37<54:11:57, 2.15s/it]

491ee7c about 4 years ago

configs
Dump 187k steps, acc 0.6574 about 4 years ago
mc4
Dump 187k steps, acc 0.6574 about 4 years ago
outputs
Step... (219001/250000 | Loss: 1.6840890645980835, Acc: 0.6597731709480286): 64%|██████████████ | 159238/250000 [81:41:37<54:11:57, 2.15s/it] about 4 years ago
.gitattributes

875 Bytes

Step... (200001/250000 | Loss: 1.6965291500091553, Acc: 0.6575480699539185): 56%|████████████▎ | 140093/250000 [71:33:45<52:41:15, 1.73s/it] about 4 years ago
.gitignore

39 Bytes

Step... (200001/250000 | Loss: 1.6965291500091553, Acc: 0.6575480699539185): 56%|████████████▎ | 140093/250000 [71:33:45<52:41:15, 1.73s/it] about 4 years ago
config.json

618 Bytes

Dump 187k steps, acc 0.6574 about 4 years ago
convert.py

876 Bytes

Dump 187k steps, acc 0.6574 about 4 years ago
flax_model.msgpack

250 MB
LFS

Step... (214001/250000 | Loss: 1.6834079027175903, Acc: 0.6600053906440735): 62%|█████████████▋ | 154922/250000 [79:19:10<50:28:22, 1.91s/it] about 4 years ago
mc4-es-train-50M-gaussian-stats.csv.tar.gz

546 MB
LFS

Model at 191k steps, acc 0.6562. Dataset stats about 4 years ago
merges.txt

514 kB

Dump 187k steps, acc 0.6574 about 4 years ago
pytorch_model.bin

499 MB
LFS

Step... (214001/250000 | Loss: 1.6834079027175903, Acc: 0.6600053906440735): 62%|█████████████▋ | 154922/250000 [79:19:10<50:28:22, 1.91s/it] about 4 years ago
run_mlm_flax_stream.py

32.9 kB

Dump 187k steps, acc 0.6574 about 4 years ago
run_mlm_flax_stream.py.orig

30.8 kB

Dump 187k steps, acc 0.6574 about 4 years ago
run_stream.log

27.2 MB
LFS

Step... (219001/250000 | Loss: 1.6840890645980835, Acc: 0.6597731709480286): 64%|██████████████ | 159238/250000 [81:41:37<54:11:57, 2.15s/it] about 4 years ago
run_stream.sh

1.03 kB

Dump 187k steps, acc 0.6574 about 4 years ago
special_tokens_map.json

239 Bytes

Dump 187k steps, acc 0.6574 about 4 years ago
tokenizer.json

1.47 MB

Dump 187k steps, acc 0.6574 about 4 years ago
tokenizer_config.json

292 Bytes

Dump 187k steps, acc 0.6574 about 4 years ago
vocab.json

855 kB

Dump 187k steps, acc 0.6574 about 4 years ago