kertob commited on
Commit
8dcc65d
·
verified ·
1 Parent(s): 8d103fa

Training in progress, step 100

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d5b94916d954962c5a0ae07658de35b98e2e53f254ded5ba3de5ac1a4af467ec
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2caded698b70db5e4450894fb380e0b5d838d1b82631c00cd3ed66bbfa6781ec
3
  size 261131840
runs/Mar13_11-36-50_7acbe5a74b63/events.out.tfevents.1710329812.7acbe5a74b63.337.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc8e6aed1719e3bab9eb684a5c63618dac708e9954ed1e92bff1fcc9e5091d65
3
- size 7413
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbf5c4b79d27b82d78120f25128ec7d3d17c56dba11ea337f0e98740bc387e90
3
+ size 7620
wandb/debug-internal.log CHANGED
@@ -948,3 +948,47 @@
948
  2024-03-13 11:50:11,179 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
949
  2024-03-13 11:50:12,350 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
950
  2024-03-13 11:50:17,351 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
948
  2024-03-13 11:50:11,179 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
949
  2024-03-13 11:50:12,350 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
950
  2024-03-13 11:50:17,351 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
951
+ 2024-03-13 11:50:22,338 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
952
+ 2024-03-13 11:50:23,338 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
953
+ 2024-03-13 11:50:26,107 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
954
+ 2024-03-13 11:50:26,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
955
+ 2024-03-13 11:50:26,147 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
956
+ 2024-03-13 11:50:29,260 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
957
+ 2024-03-13 11:50:34,261 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
958
+ 2024-03-13 11:50:39,262 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
959
+ 2024-03-13 11:50:41,107 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
960
+ 2024-03-13 11:50:41,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
961
+ 2024-03-13 11:50:41,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
962
+ 2024-03-13 11:50:44,272 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
963
+ 2024-03-13 11:50:49,273 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
964
+ 2024-03-13 11:50:52,338 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
965
+ 2024-03-13 11:50:54,339 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
966
+ 2024-03-13 11:50:56,108 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
967
+ 2024-03-13 11:50:56,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
968
+ 2024-03-13 11:50:56,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
969
+ 2024-03-13 11:51:00,226 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
970
+ 2024-03-13 11:51:05,227 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
971
+ 2024-03-13 11:51:10,228 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
972
+ 2024-03-13 11:51:11,108 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
973
+ 2024-03-13 11:51:11,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
974
+ 2024-03-13 11:51:11,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
975
+ 2024-03-13 11:51:15,252 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
976
+ 2024-03-13 11:51:20,253 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
977
+ 2024-03-13 11:51:22,339 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
978
+ 2024-03-13 11:51:25,340 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
979
+ 2024-03-13 11:51:26,108 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
980
+ 2024-03-13 11:51:26,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
981
+ 2024-03-13 11:51:26,149 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
982
+ 2024-03-13 11:51:31,255 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
983
+ 2024-03-13 11:51:36,256 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
984
+ 2024-03-13 11:51:40,289 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
985
+ 2024-03-13 11:51:40,290 DEBUG SenderThread:5135 [sender.py:send():378] send: history
986
+ 2024-03-13 11:51:40,291 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
987
+ 2024-03-13 11:51:40,291 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
988
+ 2024-03-13 11:51:41,128 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
989
+ 2024-03-13 11:51:41,129 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
990
+ 2024-03-13 11:51:41,143 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
991
+ 2024-03-13 11:51:41,169 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
992
+ 2024-03-13 11:51:41,292 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
993
+ 2024-03-13 11:51:46,293 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
994
+ 2024-03-13 11:51:51,294 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.1823, "train/grad_norm": 0.6431258320808411, "train/learning_rate": 6.044837815156377e-05, "train/epoch": 7.2, "train/global_step": 90, "_timestamp": 1710330610.2621236, "_runtime": 1786.880114555359, "_step": 12, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
 
1
+ {"train/loss": 0.2037, "train/grad_norm": 0.6838237643241882, "train/learning_rate": 5.242811110572242e-05, "train/epoch": 8.0, "train/global_step": 100, "_timestamp": 1710330700.2891643, "_runtime": 1876.9071552753448, "_step": 13, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
wandb/run-20240313_112023-t8o614bo/logs/debug-internal.log CHANGED
@@ -948,3 +948,47 @@
948
  2024-03-13 11:50:11,179 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
949
  2024-03-13 11:50:12,350 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
950
  2024-03-13 11:50:17,351 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
948
  2024-03-13 11:50:11,179 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
949
  2024-03-13 11:50:12,350 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
950
  2024-03-13 11:50:17,351 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
951
+ 2024-03-13 11:50:22,338 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
952
+ 2024-03-13 11:50:23,338 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
953
+ 2024-03-13 11:50:26,107 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
954
+ 2024-03-13 11:50:26,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
955
+ 2024-03-13 11:50:26,147 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
956
+ 2024-03-13 11:50:29,260 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
957
+ 2024-03-13 11:50:34,261 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
958
+ 2024-03-13 11:50:39,262 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
959
+ 2024-03-13 11:50:41,107 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
960
+ 2024-03-13 11:50:41,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
961
+ 2024-03-13 11:50:41,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
962
+ 2024-03-13 11:50:44,272 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
963
+ 2024-03-13 11:50:49,273 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
964
+ 2024-03-13 11:50:52,338 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
965
+ 2024-03-13 11:50:54,339 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
966
+ 2024-03-13 11:50:56,108 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
967
+ 2024-03-13 11:50:56,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
968
+ 2024-03-13 11:50:56,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
969
+ 2024-03-13 11:51:00,226 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
970
+ 2024-03-13 11:51:05,227 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
971
+ 2024-03-13 11:51:10,228 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
972
+ 2024-03-13 11:51:11,108 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
973
+ 2024-03-13 11:51:11,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
974
+ 2024-03-13 11:51:11,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
975
+ 2024-03-13 11:51:15,252 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
976
+ 2024-03-13 11:51:20,253 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
977
+ 2024-03-13 11:51:22,339 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
978
+ 2024-03-13 11:51:25,340 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
979
+ 2024-03-13 11:51:26,108 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
980
+ 2024-03-13 11:51:26,108 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
981
+ 2024-03-13 11:51:26,149 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
982
+ 2024-03-13 11:51:31,255 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
983
+ 2024-03-13 11:51:36,256 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
984
+ 2024-03-13 11:51:40,289 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
985
+ 2024-03-13 11:51:40,290 DEBUG SenderThread:5135 [sender.py:send():378] send: history
986
+ 2024-03-13 11:51:40,291 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
987
+ 2024-03-13 11:51:40,291 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
988
+ 2024-03-13 11:51:41,128 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
989
+ 2024-03-13 11:51:41,129 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
990
+ 2024-03-13 11:51:41,143 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
991
+ 2024-03-13 11:51:41,169 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
992
+ 2024-03-13 11:51:41,292 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
993
+ 2024-03-13 11:51:46,293 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
994
+ 2024-03-13 11:51:51,294 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb CHANGED
Binary files a/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb and b/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb differ