Mohamed Boghdady
commited on
End of training
Browse files- README.md +72 -0
- generation_config.json +16 -0
- runs/Jul19_09-05-25_cfc182b336d9/events.out.tfevents.1721379927.cfc182b336d9.35.1 +2 -2
- wandb/debug-internal.log +252 -0
- wandb/debug.log +3 -0
- wandb/run-20240719_090532-oy10h8oj/files/output.log +2 -0
- wandb/run-20240719_090532-oy10h8oj/files/wandb-summary.json +1 -1
- wandb/run-20240719_090532-oy10h8oj/logs/debug-internal.log +252 -0
- wandb/run-20240719_090532-oy10h8oj/logs/debug.log +3 -0
- wandb/run-20240719_090532-oy10h8oj/run-oy10h8oj.wandb +0 -0
README.md
ADDED
|
@@ -0,0 +1,72 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: Helsinki-NLP/opus-mt-ar-en
|
| 4 |
+
tags:
|
| 5 |
+
- generated_from_trainer
|
| 6 |
+
metrics:
|
| 7 |
+
- bleu
|
| 8 |
+
model-index:
|
| 9 |
+
- name: working
|
| 10 |
+
results: []
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 14 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 15 |
+
|
| 16 |
+
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/boghdady95/huggingface/runs/oy10h8oj)
|
| 17 |
+
# working
|
| 18 |
+
|
| 19 |
+
This model is a fine-tuned version of [Helsinki-NLP/opus-mt-ar-en](https://huggingface.co/Helsinki-NLP/opus-mt-ar-en) on an unknown dataset.
|
| 20 |
+
It achieves the following results on the evaluation set:
|
| 21 |
+
- Loss: 0.2987
|
| 22 |
+
- Bleu: 31.8518
|
| 23 |
+
- Gen Len: 34.0136
|
| 24 |
+
|
| 25 |
+
## Model description
|
| 26 |
+
|
| 27 |
+
More information needed
|
| 28 |
+
|
| 29 |
+
## Intended uses & limitations
|
| 30 |
+
|
| 31 |
+
More information needed
|
| 32 |
+
|
| 33 |
+
## Training and evaluation data
|
| 34 |
+
|
| 35 |
+
More information needed
|
| 36 |
+
|
| 37 |
+
## Training procedure
|
| 38 |
+
|
| 39 |
+
### Training hyperparameters
|
| 40 |
+
|
| 41 |
+
The following hyperparameters were used during training:
|
| 42 |
+
- learning_rate: 2e-05
|
| 43 |
+
- train_batch_size: 16
|
| 44 |
+
- eval_batch_size: 16
|
| 45 |
+
- seed: 42
|
| 46 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 47 |
+
- lr_scheduler_type: linear
|
| 48 |
+
- num_epochs: 10
|
| 49 |
+
- mixed_precision_training: Native AMP
|
| 50 |
+
|
| 51 |
+
### Training results
|
| 52 |
+
|
| 53 |
+
| Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
|
| 54 |
+
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
|
| 55 |
+
| No log | 1.0 | 312 | 0.3560 | 25.127 | 33.2927 |
|
| 56 |
+
| 0.6275 | 2.0 | 624 | 0.3309 | 27.7903 | 34.3769 |
|
| 57 |
+
| 0.6275 | 3.0 | 936 | 0.3176 | 28.8587 | 33.1307 |
|
| 58 |
+
| 0.2524 | 4.0 | 1248 | 0.3098 | 29.8775 | 33.5782 |
|
| 59 |
+
| 0.219 | 5.0 | 1560 | 0.3057 | 30.629 | 33.6736 |
|
| 60 |
+
| 0.219 | 6.0 | 1872 | 0.3026 | 31.2601 | 33.854 |
|
| 61 |
+
| 0.2029 | 7.0 | 2184 | 0.3007 | 31.6296 | 33.9687 |
|
| 62 |
+
| 0.2029 | 8.0 | 2496 | 0.2997 | 31.6706 | 33.6327 |
|
| 63 |
+
| 0.1895 | 9.0 | 2808 | 0.2989 | 31.5995 | 33.9904 |
|
| 64 |
+
| 0.182 | 10.0 | 3120 | 0.2987 | 31.8518 | 34.0136 |
|
| 65 |
+
|
| 66 |
+
|
| 67 |
+
### Framework versions
|
| 68 |
+
|
| 69 |
+
- Transformers 4.42.3
|
| 70 |
+
- Pytorch 2.1.2
|
| 71 |
+
- Datasets 2.20.0
|
| 72 |
+
- Tokenizers 0.19.1
|
generation_config.json
ADDED
|
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"bad_words_ids": [
|
| 3 |
+
[
|
| 4 |
+
62833
|
| 5 |
+
]
|
| 6 |
+
],
|
| 7 |
+
"bos_token_id": 0,
|
| 8 |
+
"decoder_start_token_id": 62833,
|
| 9 |
+
"eos_token_id": 0,
|
| 10 |
+
"forced_eos_token_id": 0,
|
| 11 |
+
"max_length": 512,
|
| 12 |
+
"num_beams": 4,
|
| 13 |
+
"pad_token_id": 62833,
|
| 14 |
+
"renormalize_logits": true,
|
| 15 |
+
"transformers_version": "4.42.3"
|
| 16 |
+
}
|
runs/Jul19_09-05-25_cfc182b336d9/events.out.tfevents.1721379927.cfc182b336d9.35.1
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0c8c1a3b617bc13598d24471affff31430a18a0b8451a2cf814b8c9fdcacbfd7
|
| 3 |
+
size 11043
|
wandb/debug-internal.log
CHANGED
|
@@ -4881,3 +4881,255 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 4881 |
2024-07-19 10:04:06,090 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4882 |
2024-07-19 10:04:07,091 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4883 |
2024-07-19 10:04:08,100 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4881 |
2024-07-19 10:04:06,090 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4882 |
2024-07-19 10:04:07,091 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4883 |
2024-07-19 10:04:08,100 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4884 |
+
2024-07-19 10:04:09,094 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4885 |
+
2024-07-19 10:04:09,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4886 |
+
2024-07-19 10:04:10,094 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4887 |
+
2024-07-19 10:04:11,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4888 |
+
2024-07-19 10:04:12,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4889 |
+
2024-07-19 10:04:13,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4890 |
+
2024-07-19 10:04:14,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4891 |
+
2024-07-19 10:04:14,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4892 |
+
2024-07-19 10:04:15,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4893 |
+
2024-07-19 10:04:16,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4894 |
+
2024-07-19 10:04:17,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4895 |
+
2024-07-19 10:04:18,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4896 |
+
2024-07-19 10:04:19,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4897 |
+
2024-07-19 10:04:19,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4898 |
+
2024-07-19 10:04:19,519 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4899 |
+
2024-07-19 10:04:20,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4900 |
+
2024-07-19 10:04:20,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4901 |
+
2024-07-19 10:04:21,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4902 |
+
2024-07-19 10:04:22,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4903 |
+
2024-07-19 10:04:23,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4904 |
+
2024-07-19 10:04:24,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4905 |
+
2024-07-19 10:04:25,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4906 |
+
2024-07-19 10:04:25,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4907 |
+
2024-07-19 10:04:26,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4908 |
+
2024-07-19 10:04:27,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4909 |
+
2024-07-19 10:04:28,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4910 |
+
2024-07-19 10:04:29,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4911 |
+
2024-07-19 10:04:30,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4912 |
+
2024-07-19 10:04:30,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4913 |
+
2024-07-19 10:04:31,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4914 |
+
2024-07-19 10:04:32,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4915 |
+
2024-07-19 10:04:33,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4916 |
+
2024-07-19 10:04:33,444 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 4917 |
+
2024-07-19 10:04:34,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4918 |
+
2024-07-19 10:04:34,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4919 |
+
2024-07-19 10:04:34,519 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4920 |
+
2024-07-19 10:04:35,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4921 |
+
2024-07-19 10:04:36,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4922 |
+
2024-07-19 10:04:36,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4923 |
+
2024-07-19 10:04:37,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4924 |
+
2024-07-19 10:04:38,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4925 |
+
2024-07-19 10:04:39,099 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4926 |
+
2024-07-19 10:04:40,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4927 |
+
2024-07-19 10:04:41,099 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4928 |
+
2024-07-19 10:04:41,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4929 |
+
2024-07-19 10:04:42,099 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4930 |
+
2024-07-19 10:04:43,104 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4931 |
+
2024-07-19 10:04:44,103 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4932 |
+
2024-07-19 10:04:45,103 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4933 |
+
2024-07-19 10:04:46,110 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4934 |
+
2024-07-19 10:04:46,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4935 |
+
2024-07-19 10:04:47,110 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4936 |
+
2024-07-19 10:04:48,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4937 |
+
2024-07-19 10:04:49,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4938 |
+
2024-07-19 10:04:49,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4939 |
+
2024-07-19 10:04:49,519 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4940 |
+
2024-07-19 10:04:50,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4941 |
+
2024-07-19 10:04:51,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4942 |
+
2024-07-19 10:04:52,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4943 |
+
2024-07-19 10:04:52,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4944 |
+
2024-07-19 10:04:53,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4945 |
+
2024-07-19 10:04:54,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4946 |
+
2024-07-19 10:04:55,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4947 |
+
2024-07-19 10:04:56,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4948 |
+
2024-07-19 10:04:57,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4949 |
+
2024-07-19 10:04:58,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4950 |
+
2024-07-19 10:04:58,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4951 |
+
2024-07-19 10:04:59,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4952 |
+
2024-07-19 10:05:00,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4953 |
+
2024-07-19 10:05:01,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4954 |
+
2024-07-19 10:05:02,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4955 |
+
2024-07-19 10:05:03,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4956 |
+
2024-07-19 10:05:03,444 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 4957 |
+
2024-07-19 10:05:04,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4958 |
+
2024-07-19 10:05:04,445 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4959 |
+
2024-07-19 10:05:04,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4960 |
+
2024-07-19 10:05:04,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4961 |
+
2024-07-19 10:05:05,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4962 |
+
2024-07-19 10:05:06,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4963 |
+
2024-07-19 10:05:07,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4964 |
+
2024-07-19 10:05:08,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4965 |
+
2024-07-19 10:05:09,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4966 |
+
2024-07-19 10:05:09,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4967 |
+
2024-07-19 10:05:10,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4968 |
+
2024-07-19 10:05:11,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4969 |
+
2024-07-19 10:05:12,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4970 |
+
2024-07-19 10:05:13,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4971 |
+
2024-07-19 10:05:14,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4972 |
+
2024-07-19 10:05:14,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4973 |
+
2024-07-19 10:05:15,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4974 |
+
2024-07-19 10:05:16,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4975 |
+
2024-07-19 10:05:17,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4976 |
+
2024-07-19 10:05:18,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4977 |
+
2024-07-19 10:05:19,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4978 |
+
2024-07-19 10:05:19,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4979 |
+
2024-07-19 10:05:19,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4980 |
+
2024-07-19 10:05:19,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4981 |
+
2024-07-19 10:05:20,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4982 |
+
2024-07-19 10:05:21,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4983 |
+
2024-07-19 10:05:22,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4984 |
+
2024-07-19 10:05:23,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4985 |
+
2024-07-19 10:05:24,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4986 |
+
2024-07-19 10:05:25,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4987 |
+
2024-07-19 10:05:25,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4988 |
+
2024-07-19 10:05:26,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4989 |
+
2024-07-19 10:05:27,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4990 |
+
2024-07-19 10:05:28,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4991 |
+
2024-07-19 10:05:29,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4992 |
+
2024-07-19 10:05:30,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4993 |
+
2024-07-19 10:05:30,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4994 |
+
2024-07-19 10:05:31,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4995 |
+
2024-07-19 10:05:32,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4996 |
+
2024-07-19 10:05:33,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4997 |
+
2024-07-19 10:05:33,445 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 4998 |
+
2024-07-19 10:05:34,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4999 |
+
2024-07-19 10:05:34,520 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5000 |
+
2024-07-19 10:05:34,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5001 |
+
2024-07-19 10:05:35,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5002 |
+
2024-07-19 10:05:35,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5003 |
+
2024-07-19 10:05:36,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5004 |
+
2024-07-19 10:05:37,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5005 |
+
2024-07-19 10:05:38,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5006 |
+
2024-07-19 10:05:39,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5007 |
+
2024-07-19 10:05:40,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5008 |
+
2024-07-19 10:05:40,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5009 |
+
2024-07-19 10:05:41,122 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5010 |
+
2024-07-19 10:05:42,122 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5011 |
+
2024-07-19 10:05:43,122 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5012 |
+
2024-07-19 10:05:44,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5013 |
+
2024-07-19 10:05:45,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5014 |
+
2024-07-19 10:05:46,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5015 |
+
2024-07-19 10:05:46,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5016 |
+
2024-07-19 10:05:47,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5017 |
+
2024-07-19 10:05:48,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5018 |
+
2024-07-19 10:05:49,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5019 |
+
2024-07-19 10:05:49,520 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5020 |
+
2024-07-19 10:05:49,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5021 |
+
2024-07-19 10:05:50,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5022 |
+
2024-07-19 10:05:51,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5023 |
+
2024-07-19 10:05:51,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5024 |
+
2024-07-19 10:05:52,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5025 |
+
2024-07-19 10:05:53,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5026 |
+
2024-07-19 10:05:54,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5027 |
+
2024-07-19 10:05:55,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5028 |
+
2024-07-19 10:05:56,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5029 |
+
2024-07-19 10:05:57,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5030 |
+
2024-07-19 10:05:57,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5031 |
+
2024-07-19 10:05:58,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5032 |
+
2024-07-19 10:05:59,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5033 |
+
2024-07-19 10:06:00,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5034 |
+
2024-07-19 10:06:01,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5035 |
+
2024-07-19 10:06:02,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5036 |
+
2024-07-19 10:06:03,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5037 |
+
2024-07-19 10:06:03,446 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 5038 |
+
2024-07-19 10:06:03,448 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5039 |
+
2024-07-19 10:06:04,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5040 |
+
2024-07-19 10:06:04,521 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5041 |
+
2024-07-19 10:06:04,521 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5042 |
+
2024-07-19 10:06:05,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5043 |
+
2024-07-19 10:06:06,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5044 |
+
2024-07-19 10:06:07,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5045 |
+
2024-07-19 10:06:08,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5046 |
+
2024-07-19 10:06:08,868 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5047 |
+
2024-07-19 10:06:09,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5048 |
+
2024-07-19 10:06:10,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5049 |
+
2024-07-19 10:06:11,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5050 |
+
2024-07-19 10:06:12,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5051 |
+
2024-07-19 10:06:13,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5052 |
+
2024-07-19 10:06:13,868 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5053 |
+
2024-07-19 10:06:14,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5054 |
+
2024-07-19 10:06:15,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5055 |
+
2024-07-19 10:06:16,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5056 |
+
2024-07-19 10:06:17,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5057 |
+
2024-07-19 10:06:18,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5058 |
+
2024-07-19 10:06:19,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5059 |
+
2024-07-19 10:06:19,520 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5060 |
+
2024-07-19 10:06:19,521 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5061 |
+
2024-07-19 10:06:19,777 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5062 |
+
2024-07-19 10:06:20,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5063 |
+
2024-07-19 10:06:21,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5064 |
+
2024-07-19 10:06:22,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5065 |
+
2024-07-19 10:06:23,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5066 |
+
2024-07-19 10:06:24,137 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5067 |
+
2024-07-19 10:06:24,868 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5068 |
+
2024-07-19 10:06:25,137 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5069 |
+
2024-07-19 10:06:26,305 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5070 |
+
2024-07-19 10:06:27,311 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5071 |
+
2024-07-19 10:06:28,377 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5072 |
+
2024-07-19 10:06:29,311 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5073 |
+
2024-07-19 10:06:29,869 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5074 |
+
2024-07-19 10:06:30,336 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5075 |
+
2024-07-19 10:06:31,311 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5076 |
+
2024-07-19 10:06:32,332 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5077 |
+
2024-07-19 10:06:33,316 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5078 |
+
2024-07-19 10:06:33,446 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 5079 |
+
2024-07-19 10:06:34,281 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5080 |
+
2024-07-19 10:06:34,653 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5081 |
+
2024-07-19 10:06:34,653 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5082 |
+
2024-07-19 10:06:34,888 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5083 |
+
2024-07-19 10:06:35,347 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5084 |
+
2024-07-19 10:06:36,327 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5085 |
+
2024-07-19 10:06:37,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5086 |
+
2024-07-19 10:06:38,317 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5087 |
+
2024-07-19 10:06:39,333 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5088 |
+
2024-07-19 10:06:39,976 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5089 |
+
2024-07-19 10:06:40,307 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5090 |
+
2024-07-19 10:06:41,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5091 |
+
2024-07-19 10:06:42,038 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history
|
| 5092 |
+
2024-07-19 10:06:42,039 DEBUG SenderThread:143 [sender.py:send():379] send: history
|
| 5093 |
+
2024-07-19 10:06:42,040 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5094 |
+
2024-07-19 10:06:42,040 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5095 |
+
2024-07-19 10:06:42,081 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history
|
| 5096 |
+
2024-07-19 10:06:42,082 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause
|
| 5097 |
+
2024-07-19 10:06:42,082 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread
|
| 5098 |
+
2024-07-19 10:06:42,082 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor
|
| 5099 |
+
2024-07-19 10:06:42,083 DEBUG SenderThread:143 [sender.py:send():379] send: telemetry
|
| 5100 |
+
2024-07-19 10:06:42,083 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5101 |
+
2024-07-19 10:06:42,083 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop
|
| 5102 |
+
2024-07-19 10:06:42,084 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics
|
| 5103 |
+
2024-07-19 10:06:42,084 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor
|
| 5104 |
+
2024-07-19 10:06:42,085 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor
|
| 5105 |
+
2024-07-19 10:06:42,085 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5106 |
+
2024-07-19 10:06:42,085 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5107 |
+
2024-07-19 10:06:42,086 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5108 |
+
2024-07-19 10:06:42,086 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5109 |
+
2024-07-19 10:06:42,087 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5110 |
+
2024-07-19 10:06:42,087 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5111 |
+
2024-07-19 10:06:42,088 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5112 |
+
2024-07-19 10:06:42,088 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5113 |
+
2024-07-19 10:06:42,088 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5114 |
+
2024-07-19 10:06:42,089 DEBUG SenderThread:143 [sender.py:send():379] send: history
|
| 5115 |
+
2024-07-19 10:06:42,089 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5116 |
+
2024-07-19 10:06:42,089 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5117 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [interfaces.py:finish():200] Joined gpu monitor
|
| 5118 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [interfaces.py:finish():200] Joined memory monitor
|
| 5119 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [interfaces.py:finish():200] Joined network monitor
|
| 5120 |
+
2024-07-19 10:06:42,094 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume
|
| 5121 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread
|
| 5122 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor
|
| 5123 |
+
2024-07-19 10:06:42,095 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads
|
| 5124 |
+
2024-07-19 10:06:42,095 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring
|
| 5125 |
+
2024-07-19 10:06:42,096 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring
|
| 5126 |
+
2024-07-19 10:06:42,096 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring
|
| 5127 |
+
2024-07-19 10:06:42,097 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring
|
| 5128 |
+
2024-07-19 10:06:42,098 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 5129 |
+
2024-07-19 10:06:42,098 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring
|
| 5130 |
+
2024-07-19 10:06:42,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5131 |
+
2024-07-19 10:06:42,661 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240719_090532-oy10h8oj/files/wandb-summary.json
|
| 5132 |
+
2024-07-19 10:06:43,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5133 |
+
2024-07-19 10:06:43,661 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240719_090532-oy10h8oj/files/output.log
|
| 5134 |
+
2024-07-19 10:06:44,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5135 |
+
2024-07-19 10:06:45,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
wandb/debug.log
CHANGED
|
@@ -71,3 +71,6 @@ config: {}
|
|
| 71 |
2024-07-19 09:05:49,383 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb None None {'vocab_size': 62834, 'decoder_vocab_size': 62834, 'max_position_embeddings': 512, 'd_model': 512, 'encoder_ffn_dim': 2048, 'encoder_layers': 6, 'encoder_attention_heads': 8, 'decoder_ffn_dim': 2048, 'decoder_layers': 6, 'decoder_attention_heads': 8, 'dropout': 0.1, 'attention_dropout': 0.0, 'activation_dropout': 0.0, 'activation_function': 'swish', 'init_std': 0.02, 'encoder_layerdrop': 0.0, 'decoder_layerdrop': 0.0, 'use_cache': True, 'num_hidden_layers': 6, 'scale_embedding': True, 'share_encoder_decoder_embeddings': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 512, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 4, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': [[62833]], 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': 0, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['MarianMTModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 62833, 'eos_token_id': 0, 'sep_token_id': None, 'decoder_start_token_id': 62833, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'Helsinki-NLP/opus-mt-ar-en', 'transformers_version': '4.42.3', '_num_labels': 3, 'add_bias_logits': False, 'add_final_layer_norm': False, 'classif_dropout': 0.0, 'classifier_dropout': 0.0, 'model_type': 'marian', 'normalize_before': False, 'normalize_embedding': False, 'static_position_embeddings': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 10, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Jul19_09-05-25_cfc182b336d9', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
|
| 72 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_config.py:__setitem__():151] config set model/num_parameters = 76833792 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7a8b8a3a8040>>
|
| 73 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb model/num_parameters 76833792 None
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
2024-07-19 09:05:49,383 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb None None {'vocab_size': 62834, 'decoder_vocab_size': 62834, 'max_position_embeddings': 512, 'd_model': 512, 'encoder_ffn_dim': 2048, 'encoder_layers': 6, 'encoder_attention_heads': 8, 'decoder_ffn_dim': 2048, 'decoder_layers': 6, 'decoder_attention_heads': 8, 'dropout': 0.1, 'attention_dropout': 0.0, 'activation_dropout': 0.0, 'activation_function': 'swish', 'init_std': 0.02, 'encoder_layerdrop': 0.0, 'decoder_layerdrop': 0.0, 'use_cache': True, 'num_hidden_layers': 6, 'scale_embedding': True, 'share_encoder_decoder_embeddings': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 512, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 4, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': [[62833]], 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': 0, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['MarianMTModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 62833, 'eos_token_id': 0, 'sep_token_id': None, 'decoder_start_token_id': 62833, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'Helsinki-NLP/opus-mt-ar-en', 'transformers_version': '4.42.3', '_num_labels': 3, 'add_bias_logits': False, 'add_final_layer_norm': False, 'classif_dropout': 0.0, 'classifier_dropout': 0.0, 'model_type': 'marian', 'normalize_before': False, 'normalize_embedding': False, 'static_position_embeddings': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 10, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Jul19_09-05-25_cfc182b336d9', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
|
| 72 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_config.py:__setitem__():151] config set model/num_parameters = 76833792 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7a8b8a3a8040>>
|
| 73 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb model/num_parameters 76833792 None
|
| 74 |
+
2024-07-19 10:06:42,046 INFO MainThread:35 [jupyter.py:save_ipynb():372] not saving jupyter notebook
|
| 75 |
+
2024-07-19 10:06:42,047 INFO MainThread:35 [wandb_init.py:_pause_backend():440] pausing backend
|
| 76 |
+
2024-07-19 10:06:42,064 INFO MainThread:35 [wandb_init.py:_resume_backend():445] resuming backend
|
wandb/run-20240719_090532-oy10h8oj/files/output.log
CHANGED
|
@@ -11,3 +11,5 @@ Non-default generation parameters: {'max_length': 512, 'num_beams': 4, 'bad_word
|
|
| 11 |
Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
|
| 12 |
Non-default generation parameters: {'max_length': 512, 'num_beams': 4, 'bad_words_ids': [[62833]], 'forced_eos_token_id': 0}
|
| 13 |
Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
|
|
|
|
|
|
|
|
|
| 11 |
Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
|
| 12 |
Non-default generation parameters: {'max_length': 512, 'num_beams': 4, 'bad_words_ids': [[62833]], 'forced_eos_token_id': 0}
|
| 13 |
Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
|
| 14 |
+
Non-default generation parameters: {'max_length': 512, 'num_beams': 4, 'bad_words_ids': [[62833]], 'forced_eos_token_id': 0}
|
| 15 |
+
Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
|
wandb/run-20240719_090532-oy10h8oj/files/wandb-summary.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"eval/loss": 0.
|
|
|
|
| 1 |
+
{"eval/loss": 0.2987010180950165, "eval/bleu": 31.8518, "eval/gen_len": 34.0136, "eval/runtime": 178.2204, "eval/samples_per_second": 6.997, "eval/steps_per_second": 0.438, "train/epoch": 10.0, "train/global_step": 3120, "_timestamp": 1721383602.0427294, "_runtime": 3669.6227803230286, "_step": 16, "train/loss": 0.182, "train/grad_norm": 0.5094729661941528, "train/learning_rate": 8.012820512820515e-07, "train_runtime": 3674.1695, "train_samples_per_second": 13.576, "train_steps_per_second": 0.849, "total_flos": 6737253419188224.0, "train_loss": 0.27522438978537533}
|
wandb/run-20240719_090532-oy10h8oj/logs/debug-internal.log
CHANGED
|
@@ -4881,3 +4881,255 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 4881 |
2024-07-19 10:04:06,090 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4882 |
2024-07-19 10:04:07,091 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4883 |
2024-07-19 10:04:08,100 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4881 |
2024-07-19 10:04:06,090 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4882 |
2024-07-19 10:04:07,091 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4883 |
2024-07-19 10:04:08,100 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4884 |
+
2024-07-19 10:04:09,094 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4885 |
+
2024-07-19 10:04:09,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4886 |
+
2024-07-19 10:04:10,094 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4887 |
+
2024-07-19 10:04:11,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4888 |
+
2024-07-19 10:04:12,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4889 |
+
2024-07-19 10:04:13,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4890 |
+
2024-07-19 10:04:14,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4891 |
+
2024-07-19 10:04:14,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4892 |
+
2024-07-19 10:04:15,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4893 |
+
2024-07-19 10:04:16,095 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4894 |
+
2024-07-19 10:04:17,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4895 |
+
2024-07-19 10:04:18,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4896 |
+
2024-07-19 10:04:19,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4897 |
+
2024-07-19 10:04:19,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4898 |
+
2024-07-19 10:04:19,519 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4899 |
+
2024-07-19 10:04:20,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4900 |
+
2024-07-19 10:04:20,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4901 |
+
2024-07-19 10:04:21,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4902 |
+
2024-07-19 10:04:22,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4903 |
+
2024-07-19 10:04:23,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4904 |
+
2024-07-19 10:04:24,096 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4905 |
+
2024-07-19 10:04:25,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4906 |
+
2024-07-19 10:04:25,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4907 |
+
2024-07-19 10:04:26,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4908 |
+
2024-07-19 10:04:27,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4909 |
+
2024-07-19 10:04:28,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4910 |
+
2024-07-19 10:04:29,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4911 |
+
2024-07-19 10:04:30,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4912 |
+
2024-07-19 10:04:30,864 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4913 |
+
2024-07-19 10:04:31,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4914 |
+
2024-07-19 10:04:32,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4915 |
+
2024-07-19 10:04:33,097 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4916 |
+
2024-07-19 10:04:33,444 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 4917 |
+
2024-07-19 10:04:34,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4918 |
+
2024-07-19 10:04:34,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4919 |
+
2024-07-19 10:04:34,519 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4920 |
+
2024-07-19 10:04:35,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4921 |
+
2024-07-19 10:04:36,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4922 |
+
2024-07-19 10:04:36,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4923 |
+
2024-07-19 10:04:37,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4924 |
+
2024-07-19 10:04:38,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4925 |
+
2024-07-19 10:04:39,099 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4926 |
+
2024-07-19 10:04:40,098 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4927 |
+
2024-07-19 10:04:41,099 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4928 |
+
2024-07-19 10:04:41,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4929 |
+
2024-07-19 10:04:42,099 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4930 |
+
2024-07-19 10:04:43,104 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4931 |
+
2024-07-19 10:04:44,103 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4932 |
+
2024-07-19 10:04:45,103 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4933 |
+
2024-07-19 10:04:46,110 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4934 |
+
2024-07-19 10:04:46,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4935 |
+
2024-07-19 10:04:47,110 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4936 |
+
2024-07-19 10:04:48,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4937 |
+
2024-07-19 10:04:49,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4938 |
+
2024-07-19 10:04:49,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4939 |
+
2024-07-19 10:04:49,519 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4940 |
+
2024-07-19 10:04:50,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4941 |
+
2024-07-19 10:04:51,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4942 |
+
2024-07-19 10:04:52,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4943 |
+
2024-07-19 10:04:52,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4944 |
+
2024-07-19 10:04:53,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4945 |
+
2024-07-19 10:04:54,111 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4946 |
+
2024-07-19 10:04:55,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4947 |
+
2024-07-19 10:04:56,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4948 |
+
2024-07-19 10:04:57,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4949 |
+
2024-07-19 10:04:58,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4950 |
+
2024-07-19 10:04:58,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4951 |
+
2024-07-19 10:04:59,112 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4952 |
+
2024-07-19 10:05:00,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4953 |
+
2024-07-19 10:05:01,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4954 |
+
2024-07-19 10:05:02,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4955 |
+
2024-07-19 10:05:03,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4956 |
+
2024-07-19 10:05:03,444 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 4957 |
+
2024-07-19 10:05:04,113 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4958 |
+
2024-07-19 10:05:04,445 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4959 |
+
2024-07-19 10:05:04,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4960 |
+
2024-07-19 10:05:04,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4961 |
+
2024-07-19 10:05:05,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4962 |
+
2024-07-19 10:05:06,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4963 |
+
2024-07-19 10:05:07,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4964 |
+
2024-07-19 10:05:08,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4965 |
+
2024-07-19 10:05:09,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4966 |
+
2024-07-19 10:05:09,865 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4967 |
+
2024-07-19 10:05:10,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4968 |
+
2024-07-19 10:05:11,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4969 |
+
2024-07-19 10:05:12,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4970 |
+
2024-07-19 10:05:13,114 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4971 |
+
2024-07-19 10:05:14,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4972 |
+
2024-07-19 10:05:14,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4973 |
+
2024-07-19 10:05:15,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4974 |
+
2024-07-19 10:05:16,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4975 |
+
2024-07-19 10:05:17,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4976 |
+
2024-07-19 10:05:18,115 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4977 |
+
2024-07-19 10:05:19,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4978 |
+
2024-07-19 10:05:19,519 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 4979 |
+
2024-07-19 10:05:19,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 4980 |
+
2024-07-19 10:05:19,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4981 |
+
2024-07-19 10:05:20,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4982 |
+
2024-07-19 10:05:21,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4983 |
+
2024-07-19 10:05:22,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4984 |
+
2024-07-19 10:05:23,116 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4985 |
+
2024-07-19 10:05:24,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4986 |
+
2024-07-19 10:05:25,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4987 |
+
2024-07-19 10:05:25,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4988 |
+
2024-07-19 10:05:26,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4989 |
+
2024-07-19 10:05:27,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4990 |
+
2024-07-19 10:05:28,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4991 |
+
2024-07-19 10:05:29,117 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4992 |
+
2024-07-19 10:05:30,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4993 |
+
2024-07-19 10:05:30,866 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 4994 |
+
2024-07-19 10:05:31,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4995 |
+
2024-07-19 10:05:32,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4996 |
+
2024-07-19 10:05:33,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4997 |
+
2024-07-19 10:05:33,445 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 4998 |
+
2024-07-19 10:05:34,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 4999 |
+
2024-07-19 10:05:34,520 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5000 |
+
2024-07-19 10:05:34,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5001 |
+
2024-07-19 10:05:35,118 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5002 |
+
2024-07-19 10:05:35,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5003 |
+
2024-07-19 10:05:36,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5004 |
+
2024-07-19 10:05:37,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5005 |
+
2024-07-19 10:05:38,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5006 |
+
2024-07-19 10:05:39,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5007 |
+
2024-07-19 10:05:40,119 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5008 |
+
2024-07-19 10:05:40,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5009 |
+
2024-07-19 10:05:41,122 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5010 |
+
2024-07-19 10:05:42,122 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5011 |
+
2024-07-19 10:05:43,122 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5012 |
+
2024-07-19 10:05:44,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5013 |
+
2024-07-19 10:05:45,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5014 |
+
2024-07-19 10:05:46,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5015 |
+
2024-07-19 10:05:46,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5016 |
+
2024-07-19 10:05:47,123 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5017 |
+
2024-07-19 10:05:48,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5018 |
+
2024-07-19 10:05:49,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5019 |
+
2024-07-19 10:05:49,520 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5020 |
+
2024-07-19 10:05:49,520 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5021 |
+
2024-07-19 10:05:50,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5022 |
+
2024-07-19 10:05:51,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5023 |
+
2024-07-19 10:05:51,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5024 |
+
2024-07-19 10:05:52,126 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5025 |
+
2024-07-19 10:05:53,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5026 |
+
2024-07-19 10:05:54,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5027 |
+
2024-07-19 10:05:55,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5028 |
+
2024-07-19 10:05:56,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5029 |
+
2024-07-19 10:05:57,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5030 |
+
2024-07-19 10:05:57,867 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5031 |
+
2024-07-19 10:05:58,127 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5032 |
+
2024-07-19 10:05:59,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5033 |
+
2024-07-19 10:06:00,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5034 |
+
2024-07-19 10:06:01,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5035 |
+
2024-07-19 10:06:02,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5036 |
+
2024-07-19 10:06:03,128 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5037 |
+
2024-07-19 10:06:03,446 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 5038 |
+
2024-07-19 10:06:03,448 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5039 |
+
2024-07-19 10:06:04,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5040 |
+
2024-07-19 10:06:04,521 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5041 |
+
2024-07-19 10:06:04,521 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5042 |
+
2024-07-19 10:06:05,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5043 |
+
2024-07-19 10:06:06,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5044 |
+
2024-07-19 10:06:07,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5045 |
+
2024-07-19 10:06:08,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5046 |
+
2024-07-19 10:06:08,868 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5047 |
+
2024-07-19 10:06:09,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5048 |
+
2024-07-19 10:06:10,134 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5049 |
+
2024-07-19 10:06:11,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5050 |
+
2024-07-19 10:06:12,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5051 |
+
2024-07-19 10:06:13,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5052 |
+
2024-07-19 10:06:13,868 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5053 |
+
2024-07-19 10:06:14,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5054 |
+
2024-07-19 10:06:15,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5055 |
+
2024-07-19 10:06:16,135 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5056 |
+
2024-07-19 10:06:17,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5057 |
+
2024-07-19 10:06:18,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5058 |
+
2024-07-19 10:06:19,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5059 |
+
2024-07-19 10:06:19,520 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5060 |
+
2024-07-19 10:06:19,521 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5061 |
+
2024-07-19 10:06:19,777 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5062 |
+
2024-07-19 10:06:20,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5063 |
+
2024-07-19 10:06:21,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5064 |
+
2024-07-19 10:06:22,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5065 |
+
2024-07-19 10:06:23,136 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5066 |
+
2024-07-19 10:06:24,137 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5067 |
+
2024-07-19 10:06:24,868 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5068 |
+
2024-07-19 10:06:25,137 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5069 |
+
2024-07-19 10:06:26,305 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5070 |
+
2024-07-19 10:06:27,311 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5071 |
+
2024-07-19 10:06:28,377 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5072 |
+
2024-07-19 10:06:29,311 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5073 |
+
2024-07-19 10:06:29,869 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5074 |
+
2024-07-19 10:06:30,336 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5075 |
+
2024-07-19 10:06:31,311 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5076 |
+
2024-07-19 10:06:32,332 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5077 |
+
2024-07-19 10:06:33,316 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5078 |
+
2024-07-19 10:06:33,446 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 5079 |
+
2024-07-19 10:06:34,281 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5080 |
+
2024-07-19 10:06:34,653 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status
|
| 5081 |
+
2024-07-19 10:06:34,653 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status
|
| 5082 |
+
2024-07-19 10:06:34,888 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5083 |
+
2024-07-19 10:06:35,347 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5084 |
+
2024-07-19 10:06:36,327 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5085 |
+
2024-07-19 10:06:37,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5086 |
+
2024-07-19 10:06:38,317 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5087 |
+
2024-07-19 10:06:39,333 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5088 |
+
2024-07-19 10:06:39,976 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report
|
| 5089 |
+
2024-07-19 10:06:40,307 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5090 |
+
2024-07-19 10:06:41,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5091 |
+
2024-07-19 10:06:42,038 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history
|
| 5092 |
+
2024-07-19 10:06:42,039 DEBUG SenderThread:143 [sender.py:send():379] send: history
|
| 5093 |
+
2024-07-19 10:06:42,040 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5094 |
+
2024-07-19 10:06:42,040 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5095 |
+
2024-07-19 10:06:42,081 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history
|
| 5096 |
+
2024-07-19 10:06:42,082 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause
|
| 5097 |
+
2024-07-19 10:06:42,082 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread
|
| 5098 |
+
2024-07-19 10:06:42,082 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor
|
| 5099 |
+
2024-07-19 10:06:42,083 DEBUG SenderThread:143 [sender.py:send():379] send: telemetry
|
| 5100 |
+
2024-07-19 10:06:42,083 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5101 |
+
2024-07-19 10:06:42,083 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop
|
| 5102 |
+
2024-07-19 10:06:42,084 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics
|
| 5103 |
+
2024-07-19 10:06:42,084 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor
|
| 5104 |
+
2024-07-19 10:06:42,085 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor
|
| 5105 |
+
2024-07-19 10:06:42,085 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5106 |
+
2024-07-19 10:06:42,085 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5107 |
+
2024-07-19 10:06:42,086 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5108 |
+
2024-07-19 10:06:42,086 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5109 |
+
2024-07-19 10:06:42,087 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5110 |
+
2024-07-19 10:06:42,087 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5111 |
+
2024-07-19 10:06:42,088 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5112 |
+
2024-07-19 10:06:42,088 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5113 |
+
2024-07-19 10:06:42,088 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5114 |
+
2024-07-19 10:06:42,089 DEBUG SenderThread:143 [sender.py:send():379] send: history
|
| 5115 |
+
2024-07-19 10:06:42,089 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record
|
| 5116 |
+
2024-07-19 10:06:42,089 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end
|
| 5117 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [interfaces.py:finish():200] Joined gpu monitor
|
| 5118 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [interfaces.py:finish():200] Joined memory monitor
|
| 5119 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [interfaces.py:finish():200] Joined network monitor
|
| 5120 |
+
2024-07-19 10:06:42,094 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume
|
| 5121 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread
|
| 5122 |
+
2024-07-19 10:06:42,094 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor
|
| 5123 |
+
2024-07-19 10:06:42,095 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads
|
| 5124 |
+
2024-07-19 10:06:42,095 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring
|
| 5125 |
+
2024-07-19 10:06:42,096 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring
|
| 5126 |
+
2024-07-19 10:06:42,096 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring
|
| 5127 |
+
2024-07-19 10:06:42,097 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring
|
| 5128 |
+
2024-07-19 10:06:42,098 DEBUG SenderThread:143 [sender.py:send():379] send: stats
|
| 5129 |
+
2024-07-19 10:06:42,098 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring
|
| 5130 |
+
2024-07-19 10:06:42,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5131 |
+
2024-07-19 10:06:42,661 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240719_090532-oy10h8oj/files/wandb-summary.json
|
| 5132 |
+
2024-07-19 10:06:43,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5133 |
+
2024-07-19 10:06:43,661 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240719_090532-oy10h8oj/files/output.log
|
| 5134 |
+
2024-07-19 10:06:44,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
| 5135 |
+
2024-07-19 10:06:45,286 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages
|
wandb/run-20240719_090532-oy10h8oj/logs/debug.log
CHANGED
|
@@ -71,3 +71,6 @@ config: {}
|
|
| 71 |
2024-07-19 09:05:49,383 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb None None {'vocab_size': 62834, 'decoder_vocab_size': 62834, 'max_position_embeddings': 512, 'd_model': 512, 'encoder_ffn_dim': 2048, 'encoder_layers': 6, 'encoder_attention_heads': 8, 'decoder_ffn_dim': 2048, 'decoder_layers': 6, 'decoder_attention_heads': 8, 'dropout': 0.1, 'attention_dropout': 0.0, 'activation_dropout': 0.0, 'activation_function': 'swish', 'init_std': 0.02, 'encoder_layerdrop': 0.0, 'decoder_layerdrop': 0.0, 'use_cache': True, 'num_hidden_layers': 6, 'scale_embedding': True, 'share_encoder_decoder_embeddings': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 512, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 4, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': [[62833]], 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': 0, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['MarianMTModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 62833, 'eos_token_id': 0, 'sep_token_id': None, 'decoder_start_token_id': 62833, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'Helsinki-NLP/opus-mt-ar-en', 'transformers_version': '4.42.3', '_num_labels': 3, 'add_bias_logits': False, 'add_final_layer_norm': False, 'classif_dropout': 0.0, 'classifier_dropout': 0.0, 'model_type': 'marian', 'normalize_before': False, 'normalize_embedding': False, 'static_position_embeddings': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 10, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Jul19_09-05-25_cfc182b336d9', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
|
| 72 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_config.py:__setitem__():151] config set model/num_parameters = 76833792 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7a8b8a3a8040>>
|
| 73 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb model/num_parameters 76833792 None
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
2024-07-19 09:05:49,383 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb None None {'vocab_size': 62834, 'decoder_vocab_size': 62834, 'max_position_embeddings': 512, 'd_model': 512, 'encoder_ffn_dim': 2048, 'encoder_layers': 6, 'encoder_attention_heads': 8, 'decoder_ffn_dim': 2048, 'decoder_layers': 6, 'decoder_attention_heads': 8, 'dropout': 0.1, 'attention_dropout': 0.0, 'activation_dropout': 0.0, 'activation_function': 'swish', 'init_std': 0.02, 'encoder_layerdrop': 0.0, 'decoder_layerdrop': 0.0, 'use_cache': True, 'num_hidden_layers': 6, 'scale_embedding': True, 'share_encoder_decoder_embeddings': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 512, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 4, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': [[62833]], 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': 0, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['MarianMTModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 62833, 'eos_token_id': 0, 'sep_token_id': None, 'decoder_start_token_id': 62833, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'Helsinki-NLP/opus-mt-ar-en', 'transformers_version': '4.42.3', '_num_labels': 3, 'add_bias_logits': False, 'add_final_layer_norm': False, 'classif_dropout': 0.0, 'classifier_dropout': 0.0, 'model_type': 'marian', 'normalize_before': False, 'normalize_embedding': False, 'static_position_embeddings': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 10, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Jul19_09-05-25_cfc182b336d9', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
|
| 72 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_config.py:__setitem__():151] config set model/num_parameters = 76833792 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7a8b8a3a8040>>
|
| 73 |
2024-07-19 09:05:49,391 INFO MainThread:35 [wandb_run.py:_config_callback():1382] config_cb model/num_parameters 76833792 None
|
| 74 |
+
2024-07-19 10:06:42,046 INFO MainThread:35 [jupyter.py:save_ipynb():372] not saving jupyter notebook
|
| 75 |
+
2024-07-19 10:06:42,047 INFO MainThread:35 [wandb_init.py:_pause_backend():440] pausing backend
|
| 76 |
+
2024-07-19 10:06:42,064 INFO MainThread:35 [wandb_init.py:_resume_backend():445] resuming backend
|
wandb/run-20240719_090532-oy10h8oj/run-oy10h8oj.wandb
CHANGED
|
Binary files a/wandb/run-20240719_090532-oy10h8oj/run-oy10h8oj.wandb and b/wandb/run-20240719_090532-oy10h8oj/run-oy10h8oj.wandb differ
|
|
|