kertob commited on
Commit
3dd61c6
·
verified ·
1 Parent(s): 1363907

Training in progress, step 70

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ebff988b7b90ad03b56ff65b1efe8582c576a5885356238a9dd51843b8f041dc
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:961d8dd736214c061f78791eb2be5af9a93b35a6a64f7b4e351a8f092b707b3b
3
  size 261131840
runs/Mar13_11-36-50_7acbe5a74b63/events.out.tfevents.1710329812.7acbe5a74b63.337.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:07ee81f6dfde90662aa5ee4a8b2b688b5e947105bb0da1d80868a1ab16e4b9c6
3
- size 6792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e665f030cc79f4cf63238d4b2773a58f7318f6298038fdae3e2ad95033172a8
3
+ size 6999
wandb/debug-internal.log CHANGED
@@ -818,3 +818,47 @@
818
  2024-03-13 11:45:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
819
  2024-03-13 11:45:42,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
820
  2024-03-13 11:45:47,161 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
818
  2024-03-13 11:45:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
819
  2024-03-13 11:45:42,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
820
  2024-03-13 11:45:47,161 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
821
+ 2024-03-13 11:45:52,162 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
822
+ 2024-03-13 11:45:52,331 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
823
+ 2024-03-13 11:45:56,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
824
+ 2024-03-13 11:45:56,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
825
+ 2024-03-13 11:45:56,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
826
+ 2024-03-13 11:45:58,141 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
827
+ 2024-03-13 11:46:03,142 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
828
+ 2024-03-13 11:46:08,143 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
829
+ 2024-03-13 11:46:11,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
830
+ 2024-03-13 11:46:11,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
831
+ 2024-03-13 11:46:11,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
832
+ 2024-03-13 11:46:13,159 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
833
+ 2024-03-13 11:46:18,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
834
+ 2024-03-13 11:46:22,332 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
835
+ 2024-03-13 11:46:23,333 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
836
+ 2024-03-13 11:46:26,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
837
+ 2024-03-13 11:46:26,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
838
+ 2024-03-13 11:46:26,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
839
+ 2024-03-13 11:46:29,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
840
+ 2024-03-13 11:46:34,149 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
841
+ 2024-03-13 11:46:39,150 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
842
+ 2024-03-13 11:46:41,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
843
+ 2024-03-13 11:46:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
844
+ 2024-03-13 11:46:41,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
845
+ 2024-03-13 11:46:44,182 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
846
+ 2024-03-13 11:46:49,183 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
847
+ 2024-03-13 11:46:52,333 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
848
+ 2024-03-13 11:46:54,334 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
849
+ 2024-03-13 11:46:56,082 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
850
+ 2024-03-13 11:46:56,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
851
+ 2024-03-13 11:46:56,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
852
+ 2024-03-13 11:47:00,183 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
853
+ 2024-03-13 11:47:05,184 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
854
+ 2024-03-13 11:47:10,185 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
855
+ 2024-03-13 11:47:11,082 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
856
+ 2024-03-13 11:47:11,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
857
+ 2024-03-13 11:47:11,147 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
858
+ 2024-03-13 11:47:11,307 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
859
+ 2024-03-13 11:47:11,308 DEBUG SenderThread:5135 [sender.py:send():378] send: history
860
+ 2024-03-13 11:47:11,308 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
861
+ 2024-03-13 11:47:11,309 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
862
+ 2024-03-13 11:47:12,056 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
863
+ 2024-03-13 11:47:15,311 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
864
+ 2024-03-13 11:47:20,312 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.2689, "train/grad_norm": 0.7135311365127563, "train/learning_rate": 8.2070410981557e-05, "train/epoch": 4.8, "train/global_step": 60, "_timestamp": 1710330338.5859668, "_runtime": 1515.2039577960968, "_step": 9, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
 
1
+ {"train/loss": 0.2382, "train/grad_norm": 0.7199187874794006, "train/learning_rate": 7.546600811643816e-05, "train/epoch": 5.6, "train/global_step": 70, "_timestamp": 1710330431.3066437, "_runtime": 1607.924634695053, "_step": 10, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
wandb/run-20240313_112023-t8o614bo/logs/debug-internal.log CHANGED
@@ -818,3 +818,47 @@
818
  2024-03-13 11:45:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
819
  2024-03-13 11:45:42,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
820
  2024-03-13 11:45:47,161 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
818
  2024-03-13 11:45:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
819
  2024-03-13 11:45:42,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
820
  2024-03-13 11:45:47,161 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
821
+ 2024-03-13 11:45:52,162 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
822
+ 2024-03-13 11:45:52,331 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
823
+ 2024-03-13 11:45:56,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
824
+ 2024-03-13 11:45:56,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
825
+ 2024-03-13 11:45:56,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
826
+ 2024-03-13 11:45:58,141 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
827
+ 2024-03-13 11:46:03,142 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
828
+ 2024-03-13 11:46:08,143 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
829
+ 2024-03-13 11:46:11,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
830
+ 2024-03-13 11:46:11,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
831
+ 2024-03-13 11:46:11,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
832
+ 2024-03-13 11:46:13,159 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
833
+ 2024-03-13 11:46:18,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
834
+ 2024-03-13 11:46:22,332 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
835
+ 2024-03-13 11:46:23,333 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
836
+ 2024-03-13 11:46:26,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
837
+ 2024-03-13 11:46:26,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
838
+ 2024-03-13 11:46:26,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
839
+ 2024-03-13 11:46:29,148 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
840
+ 2024-03-13 11:46:34,149 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
841
+ 2024-03-13 11:46:39,150 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
842
+ 2024-03-13 11:46:41,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
843
+ 2024-03-13 11:46:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
844
+ 2024-03-13 11:46:41,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
845
+ 2024-03-13 11:46:44,182 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
846
+ 2024-03-13 11:46:49,183 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
847
+ 2024-03-13 11:46:52,333 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
848
+ 2024-03-13 11:46:54,334 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
849
+ 2024-03-13 11:46:56,082 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
850
+ 2024-03-13 11:46:56,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
851
+ 2024-03-13 11:46:56,122 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
852
+ 2024-03-13 11:47:00,183 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
853
+ 2024-03-13 11:47:05,184 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
854
+ 2024-03-13 11:47:10,185 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
855
+ 2024-03-13 11:47:11,082 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
856
+ 2024-03-13 11:47:11,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
857
+ 2024-03-13 11:47:11,147 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
858
+ 2024-03-13 11:47:11,307 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
859
+ 2024-03-13 11:47:11,308 DEBUG SenderThread:5135 [sender.py:send():378] send: history
860
+ 2024-03-13 11:47:11,308 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
861
+ 2024-03-13 11:47:11,309 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
862
+ 2024-03-13 11:47:12,056 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
863
+ 2024-03-13 11:47:15,311 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
864
+ 2024-03-13 11:47:20,312 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb CHANGED
Binary files a/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb and b/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb differ