kertob commited on
Commit
d19a57e
·
verified ·
1 Parent(s): 4182ef6

Training in progress, step 40

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d74c7a8058997c825b750ce69d38e8dba19cb889821c99c1c772b0aa1082e8b9
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdd6791f206830fe13537459076d17491fb650f000f611d40cac0083410fa730
3
  size 261131840
runs/Mar13_11-36-50_7acbe5a74b63/events.out.tfevents.1710329812.7acbe5a74b63.337.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8722059b163b3a7a2a7703cbedf3ad0b522fa0d4dc1d6a7c902da3b56c8bf1c1
3
- size 6171
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:480e8ea3d9eaccbc93c6f0cdf1af51619caaaa2799f846f6df613aa8f5b738fa
3
+ size 6378
wandb/debug-internal.log CHANGED
@@ -689,3 +689,45 @@
689
  2024-03-13 11:41:11,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
690
  2024-03-13 11:41:12,150 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
691
  2024-03-13 11:41:17,151 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
689
  2024-03-13 11:41:11,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
690
  2024-03-13 11:41:12,150 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
691
  2024-03-13 11:41:17,151 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
692
+ 2024-03-13 11:41:22,152 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
693
+ 2024-03-13 11:41:22,325 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
694
+ 2024-03-13 11:41:26,078 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
695
+ 2024-03-13 11:41:26,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
696
+ 2024-03-13 11:41:26,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
697
+ 2024-03-13 11:41:27,209 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
698
+ 2024-03-13 11:41:32,210 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
699
+ 2024-03-13 11:41:37,211 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
700
+ 2024-03-13 11:41:41,078 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
701
+ 2024-03-13 11:41:41,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
702
+ 2024-03-13 11:41:41,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
703
+ 2024-03-13 11:41:43,164 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
704
+ 2024-03-13 11:41:48,165 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
705
+ 2024-03-13 11:41:52,326 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
706
+ 2024-03-13 11:41:53,326 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
707
+ 2024-03-13 11:41:56,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
708
+ 2024-03-13 11:41:56,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
709
+ 2024-03-13 11:41:56,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
710
+ 2024-03-13 11:41:59,228 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
711
+ 2024-03-13 11:42:04,229 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
712
+ 2024-03-13 11:42:09,230 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
713
+ 2024-03-13 11:42:11,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
714
+ 2024-03-13 11:42:11,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
715
+ 2024-03-13 11:42:11,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
716
+ 2024-03-13 11:42:15,199 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
717
+ 2024-03-13 11:42:20,201 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
718
+ 2024-03-13 11:42:22,331 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
719
+ 2024-03-13 11:42:25,332 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
720
+ 2024-03-13 11:42:26,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
721
+ 2024-03-13 11:42:26,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
722
+ 2024-03-13 11:42:26,120 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
723
+ 2024-03-13 11:42:31,253 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
724
+ 2024-03-13 11:42:36,254 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
725
+ 2024-03-13 11:42:37,062 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
726
+ 2024-03-13 11:42:37,063 DEBUG SenderThread:5135 [sender.py:send():378] send: history
727
+ 2024-03-13 11:42:37,063 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
728
+ 2024-03-13 11:42:37,064 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
729
+ 2024-03-13 11:42:37,969 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
730
+ 2024-03-13 11:42:41,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
731
+ 2024-03-13 11:42:41,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
732
+ 2024-03-13 11:42:41,080 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
733
+ 2024-03-13 11:42:42,192 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.5355, "train/grad_norm": 1.0484654903411865, "train/learning_rate": 9.627106148213522e-05, "train/epoch": 2.4, "train/global_step": 30, "_timestamp": 1710330068.3975656, "_runtime": 1245.0155565738678, "_step": 6, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
 
1
+ {"train/loss": 0.3679, "train/grad_norm": 0.982030987739563, "train/learning_rate": 9.261084118279847e-05, "train/epoch": 3.2, "train/global_step": 40, "_timestamp": 1710330157.0620253, "_runtime": 1333.6800162792206, "_step": 7, "train/train_runtime": 361.3918, "train/train_samples_per_second": 1.328, "train/train_steps_per_second": 0.083, "train/total_flos": 1585771096988928.0, "train/train_loss": 1.3836020787556966}
wandb/run-20240313_112023-t8o614bo/logs/debug-internal.log CHANGED
@@ -689,3 +689,45 @@
689
  2024-03-13 11:41:11,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
690
  2024-03-13 11:41:12,150 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
691
  2024-03-13 11:41:17,151 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
689
  2024-03-13 11:41:11,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
690
  2024-03-13 11:41:12,150 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
691
  2024-03-13 11:41:17,151 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
692
+ 2024-03-13 11:41:22,152 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
693
+ 2024-03-13 11:41:22,325 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
694
+ 2024-03-13 11:41:26,078 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
695
+ 2024-03-13 11:41:26,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
696
+ 2024-03-13 11:41:26,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
697
+ 2024-03-13 11:41:27,209 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
698
+ 2024-03-13 11:41:32,210 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
699
+ 2024-03-13 11:41:37,211 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
700
+ 2024-03-13 11:41:41,078 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
701
+ 2024-03-13 11:41:41,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
702
+ 2024-03-13 11:41:41,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
703
+ 2024-03-13 11:41:43,164 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
704
+ 2024-03-13 11:41:48,165 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
705
+ 2024-03-13 11:41:52,326 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
706
+ 2024-03-13 11:41:53,326 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
707
+ 2024-03-13 11:41:56,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
708
+ 2024-03-13 11:41:56,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
709
+ 2024-03-13 11:41:56,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
710
+ 2024-03-13 11:41:59,228 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
711
+ 2024-03-13 11:42:04,229 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
712
+ 2024-03-13 11:42:09,230 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
713
+ 2024-03-13 11:42:11,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
714
+ 2024-03-13 11:42:11,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
715
+ 2024-03-13 11:42:11,119 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
716
+ 2024-03-13 11:42:15,199 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
717
+ 2024-03-13 11:42:20,201 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
718
+ 2024-03-13 11:42:22,331 DEBUG SenderThread:5135 [sender.py:send():378] send: stats
719
+ 2024-03-13 11:42:25,332 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
720
+ 2024-03-13 11:42:26,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
721
+ 2024-03-13 11:42:26,079 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
722
+ 2024-03-13 11:42:26,120 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
723
+ 2024-03-13 11:42:31,253 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
724
+ 2024-03-13 11:42:36,254 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
725
+ 2024-03-13 11:42:37,062 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: partial_history
726
+ 2024-03-13 11:42:37,063 DEBUG SenderThread:5135 [sender.py:send():378] send: history
727
+ 2024-03-13 11:42:37,063 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: summary_record
728
+ 2024-03-13 11:42:37,064 INFO SenderThread:5135 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
729
+ 2024-03-13 11:42:37,969 INFO Thread-12 :5135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240313_112023-t8o614bo/files/wandb-summary.json
730
+ 2024-03-13 11:42:41,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: stop_status
731
+ 2024-03-13 11:42:41,079 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: internal_messages
732
+ 2024-03-13 11:42:41,080 DEBUG SenderThread:5135 [sender.py:send_request():405] send_request: stop_status
733
+ 2024-03-13 11:42:42,192 DEBUG HandlerThread:5135 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb CHANGED
Binary files a/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb and b/wandb/run-20240313_112023-t8o614bo/run-t8o614bo.wandb differ