kertob commited on
Commit
1363907
·
verified ·
1 Parent(s): 90678bc

Training in progress, step 60

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4edc6d54fcbdf5b406f2691c3960e8fbc0fe1c111d80dff0350fc4b1c2a91114
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebff988b7b90ad03b56ff65b1efe8582c576a5885356238a9dd51843b8f041dc
3
  size 261131840
runs/Mar13_11-36-50_7acbe5a74b63/events.out.tfevents.1710329812.7acbe5a74b63.337.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5649f9c5b861b9bed21be6c03f8552adccf16aa6641ff47c2624467e7caac1bc
3
- size 6585
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07ee81f6dfde90662aa5ee4a8b2b688b5e947105bb0da1d80868a1ab16e4b9c6
3
+ size 6792
wandb/debug-internal.log CHANGED
@@ -774,3 +774,47 @@
774
  2024-03-13 11:44:11,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
775
  2024-03-13 11:44:11,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
776
  2024-03-13 11:44:12,167 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
774
  2024-03-13 11:44:11,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
775
  2024-03-13 11:44:11,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
776
  2024-03-13 11:44:12,167 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
777
+ 2024-03-13 11:44:17,168 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
778
+ 2024-03-13 11:44:22,169 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
779
+ 2024-03-13 11:44:22,329 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
780
+ 2024-03-13 11:44:26,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
781
+ 2024-03-13 11:44:26,080 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
782
+ 2024-03-13 11:44:26,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
783
+ 2024-03-13 11:44:27,212 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
784
+ 2024-03-13 11:44:32,214 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
785
+ 2024-03-13 11:44:37,215 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
786
+ 2024-03-13 11:44:41,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
787
+ 2024-03-13 11:44:41,080 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
788
+ 2024-03-13 11:44:41,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
789
+ 2024-03-13 11:44:43,190 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
790
+ 2024-03-13 11:44:48,192 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
791
+ 2024-03-13 11:44:52,330 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
792
+ 2024-03-13 11:44:53,331 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
793
+ 2024-03-13 11:44:56,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
794
+ 2024-03-13 11:44:56,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
795
+ 2024-03-13 11:44:56,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
796
+ 2024-03-13 11:44:59,250 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
797
+ 2024-03-13 11:45:04,251 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
798
+ 2024-03-13 11:45:09,252 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
799
+ 2024-03-13 11:45:11,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
800
+ 2024-03-13 11:45:11,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
801
+ 2024-03-13 11:45:11,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
802
+ 2024-03-13 11:45:15,206 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
803
+ 2024-03-13 11:45:20,207 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
804
+ 2024-03-13 11:45:22,331 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
805
+ 2024-03-13 11:45:25,332 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
806
+ 2024-03-13 11:45:26,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
807
+ 2024-03-13 11:45:26,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
808
+ 2024-03-13 11:45:26,123 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
809
+ 2024-03-13 11:45:31,214 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
810
+ 2024-03-13 11:45:36,215 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
811
+ 2024-03-13 11:45:38,586 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
812
+ 2024-03-13 11:45:38,587 DEBUG SenderThread:5135 [sender.py:send():378] send: history
813
+ 2024-03-13 11:45:38,587 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
814
+ 2024-03-13 11:45:38,588 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
815
+ 2024-03-13 11:45:39,026 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
816
+ 2024-03-13 11:45:41,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
817
+ 2024-03-13 11:45:41,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
818
+ 2024-03-13 11:45:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
819
+ 2024-03-13 11:45:42,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
820
+ 2024-03-13 11:45:47,161 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.3377, "train/grad_norm": 0.9967080950737, "train/learning_rate": 8.783564079088477e-05, "train/epoch": 4.0, "train/global_step": 50, "_timestamp": 1710330246.9283016, "_runtime": 1423.5462925434113, "_step": 8, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
 
1
+ {"train/loss": 0.2689, "train/grad_norm": 0.7135311365127563, "train/learning_rate": 8.2070410981557e-05, "train/epoch": 4.8, "train/global_step": 60, "_timestamp": 1710330338.5859668, "_runtime": 1515.2039577960968, "_step": 9, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
wandb/run-20240313_112023-t8o614bo/logs/debug-internal.log CHANGED
@@ -774,3 +774,47 @@
774
  2024-03-13 11:44:11,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
775
  2024-03-13 11:44:11,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
776
  2024-03-13 11:44:12,167 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
774
  2024-03-13 11:44:11,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
775
  2024-03-13 11:44:11,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
776
  2024-03-13 11:44:12,167 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
777
+ 2024-03-13 11:44:17,168 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
778
+ 2024-03-13 11:44:22,169 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
779
+ 2024-03-13 11:44:22,329 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
780
+ 2024-03-13 11:44:26,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
781
+ 2024-03-13 11:44:26,080 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
782
+ 2024-03-13 11:44:26,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
783
+ 2024-03-13 11:44:27,212 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
784
+ 2024-03-13 11:44:32,214 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
785
+ 2024-03-13 11:44:37,215 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
786
+ 2024-03-13 11:44:41,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
787
+ 2024-03-13 11:44:41,080 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
788
+ 2024-03-13 11:44:41,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
789
+ 2024-03-13 11:44:43,190 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
790
+ 2024-03-13 11:44:48,192 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
791
+ 2024-03-13 11:44:52,330 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
792
+ 2024-03-13 11:44:53,331 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
793
+ 2024-03-13 11:44:56,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
794
+ 2024-03-13 11:44:56,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
795
+ 2024-03-13 11:44:56,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
796
+ 2024-03-13 11:44:59,250 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
797
+ 2024-03-13 11:45:04,251 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
798
+ 2024-03-13 11:45:09,252 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
799
+ 2024-03-13 11:45:11,080 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
800
+ 2024-03-13 11:45:11,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
801
+ 2024-03-13 11:45:11,121 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
802
+ 2024-03-13 11:45:15,206 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
803
+ 2024-03-13 11:45:20,207 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
804
+ 2024-03-13 11:45:22,331 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
805
+ 2024-03-13 11:45:25,332 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
806
+ 2024-03-13 11:45:26,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
807
+ 2024-03-13 11:45:26,081 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
808
+ 2024-03-13 11:45:26,123 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
809
+ 2024-03-13 11:45:31,214 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
810
+ 2024-03-13 11:45:36,215 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
811
+ 2024-03-13 11:45:38,586 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
812
+ 2024-03-13 11:45:38,587 DEBUG SenderThread:5135 [sender.py:send():378] send: history
813
+ 2024-03-13 11:45:38,587 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
814
+ 2024-03-13 11:45:38,588 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
815
+ 2024-03-13 11:45:39,026 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
816
+ 2024-03-13 11:45:41,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
817
+ 2024-03-13 11:45:41,081 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
818
+ 2024-03-13 11:45:41,082 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
819
+ 2024-03-13 11:45:42,160 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
820
+ 2024-03-13 11:45:47,161 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb CHANGED
Binary files a/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb and b/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb differ