Hugging Face's logo

Spaces:
Sanchayy
/
InternV-Demo
Runtime error

App Files Community
czczup commited on
Commit
77fe6ed
·
verified ·
1 Parent(s): 3f1b7f0

Delete logs

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. logs/controller.log +0 -0
  2. logs/controller.log.2024-07-09 +0 -0
  3. logs/model_worker_03bfe8.log +0 -83
  4. logs/model_worker_113f24.log +0 -0
  5. logs/model_worker_113f24.log.2024-07-10 +0 -0
  6. logs/model_worker_119769.log +0 -175
  7. logs/model_worker_131934.log +0 -78
  8. logs/model_worker_1380b0.log +0 -115
  9. logs/model_worker_19edde.log +0 -43
  10. logs/model_worker_1abcda.log +0 -154
  11. logs/model_worker_1c4fbd.log +0 -55
  12. logs/model_worker_1c9f40.log +0 -47
  13. logs/model_worker_1d82ce.log +0 -5
  14. logs/model_worker_21fda5.log +0 -545
  15. logs/model_worker_2370fb.log +0 -73
  16. logs/model_worker_25653c.log +0 -0
  17. logs/model_worker_25653c.log.2024-07-10 +0 -0
  18. logs/model_worker_25e2c6.log +0 -38
  19. logs/model_worker_2fa00c.log +0 -85
  20. logs/model_worker_30a4c1.log +0 -36
  21. logs/model_worker_326a51.log +0 -13
  22. logs/model_worker_35f772.log +0 -155
  23. logs/model_worker_3a45cb.log +0 -92
  24. logs/model_worker_3b3ed1.log +0 -0
  25. logs/model_worker_3b962c.log +0 -0
  26. logs/model_worker_3b962c.log.2024-07-10 +0 -0
  27. logs/model_worker_4525cb.log +0 -548
  28. logs/model_worker_4ae09d.log +0 -88
  29. logs/model_worker_4e3f4f.log +0 -539
  30. logs/model_worker_4e9294.log +0 -546
  31. logs/model_worker_55a7c0.log +0 -614
  32. logs/model_worker_578439.log +0 -154
  33. logs/model_worker_588a2c.log +0 -8
  34. logs/model_worker_5bf53a.log +0 -111
  35. logs/model_worker_5f9311.log +0 -268
  36. logs/model_worker_6223f6.log +0 -0
  37. logs/model_worker_6223f6.log.2024-07-10 +0 -0
  38. logs/model_worker_6a86a0.log +0 -79
  39. logs/model_worker_6ed459.log +0 -402
  40. logs/model_worker_762b3d.log +0 -125
  41. logs/model_worker_7818e5.log +0 -392
  42. logs/model_worker_783296.log +0 -15
  43. logs/model_worker_7b81e4.log +0 -0
  44. logs/model_worker_7b81e4.log.2024-07-10 +0 -0
  45. logs/model_worker_7c887a.log +0 -20
  46. logs/model_worker_7f44d1.log +0 -13
  47. logs/model_worker_8e389c.log +0 -75
  48. logs/model_worker_91b7e4.log +0 -64
  49. logs/model_worker_9a9b40.log +0 -0
  50. logs/model_worker_a0e470.log +0 -386
logs/controller.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/controller.log.2024-07-09 DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_03bfe8.log DELETED
@@ -1,83 +0,0 @@
1
- 2024-07-11 22:32:29 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.66.196:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-78B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:32:29 | INFO | model_worker | Loading the model InternVL2-78B on worker 03bfe8 ...
3
- 2024-07-11 22:32:29 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:32:29 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:32:33 | ERROR | stderr |
6
- 2024-07-11 22:32:36 | ERROR | stderr |
7
- 2024-07-11 22:32:38 | ERROR | stderr |
8
- 2024-07-11 22:32:40 | ERROR | stderr |
9
- 2024-07-11 22:32:42 | ERROR | stderr |
10
- 2024-07-11 22:32:44 | ERROR | stderr |
11
- 2024-07-11 22:32:46 | ERROR | stderr |
12
- 2024-07-11 22:32:48 | ERROR | stderr |
13
- 2024-07-11 22:32:50 | ERROR | stderr |
14
- 2024-07-11 22:32:53 | ERROR | stderr |
15
- 2024-07-11 22:32:55 | ERROR | stderr |
16
- 2024-07-11 22:32:57 | ERROR | stderr |
17
- 2024-07-11 22:32:59 | ERROR | stderr |
18
- 2024-07-11 22:33:01 | ERROR | stderr |
19
- 2024-07-11 22:33:03 | ERROR | stderr |
20
- 2024-07-11 22:33:04 | ERROR | stderr |
21
- 2024-07-11 22:33:06 | ERROR | stderr |
22
- 2024-07-11 22:33:08 | ERROR | stderr |
23
- 2024-07-11 22:33:10 | ERROR | stderr |
24
- 2024-07-11 22:33:12 | ERROR | stderr |
25
- 2024-07-11 22:33:14 | ERROR | stderr |
26
- 2024-07-11 22:33:16 | ERROR | stderr |
27
- 2024-07-11 22:33:18 | ERROR | stderr |
28
- 2024-07-11 22:33:20 | ERROR | stderr |
29
- 2024-07-11 22:33:22 | ERROR | stderr |
30
- 2024-07-11 22:33:24 | ERROR | stderr |
31
- 2024-07-11 22:33:26 | ERROR | stderr |
32
- 2024-07-11 22:33:28 | ERROR | stderr |
33
- 2024-07-11 22:33:29 | ERROR | stderr |
34
- 2024-07-11 22:33:31 | ERROR | stderr |
35
- 2024-07-11 22:33:33 | ERROR | stderr |
36
- 2024-07-11 22:33:36 | ERROR | stderr |
37
- 2024-07-11 22:33:37 | ERROR | stderr |
38
- 2024-07-11 22:33:39 | ERROR | stderr |
39
- 2024-07-11 22:33:39 | ERROR | stderr |
40
- 2024-07-11 22:33:39 | ERROR | stderr |
41
- 2024-07-11 22:33:40 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:33:40 | ERROR | stderr | INFO: Started server process [41841]
43
- 2024-07-11 22:33:40 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:33:40 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:33:40 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40007 (Press CTRL+C to quit)
46
- 2024-07-11 22:33:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
47
- 2024-07-11 22:34:02 | INFO | stdout | INFO: 10.140.60.209:44754 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:34:04 | INFO | stdout | INFO: 10.140.60.209:44774 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:44794 - "POST /worker_get_status HTTP/1.1" 200 OK
50
- 2024-07-11 22:34:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
51
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:44802 - "POST /worker_generate_stream HTTP/1.1" 200 OK
52
- 2024-07-11 22:34:05 | INFO | model_worker | max_input_tile_list: [12]
53
- 2024-07-11 22:34:06 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
54
- 2024-07-11 22:34:06 | INFO | model_worker | []
55
- 2024-07-11 22:34:06 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fca140d51e0>}
56
- 2024-07-11 22:34:07 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
57
- 2024-07-11 22:34:07 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
58
- 2024-07-11 22:34:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
59
- 2024-07-11 22:34:13 | ERROR | stderr | Exception in thread Thread-3 (chat):
60
- 2024-07-11 22:34:13 | ERROR | stderr | Traceback (most recent call last):
61
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
62
- 2024-07-11 22:34:13 | ERROR | stderr | self.run()
63
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 946, in run
64
- 2024-07-11 22:34:13 | ERROR | stderr | self._target(*self._args, **self._kwargs)
65
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 283, in chat
66
- 2024-07-11 22:34:13 | ERROR | stderr | generation_output = self.generate(
67
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
68
- 2024-07-11 22:34:13 | ERROR | stderr | return func(*args, **kwargs)
69
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 333, in generate
70
- 2024-07-11 22:34:13 | ERROR | stderr | outputs = self.language_model.generate(
71
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
72
- 2024-07-11 22:34:13 | ERROR | stderr | return func(*args, **kwargs)
73
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 1525, in generate
74
- 2024-07-11 22:34:13 | ERROR | stderr | return self.sample(
75
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 2641, in sample
76
- 2024-07-11 22:34:13 | ERROR | stderr | next_token_scores = logits_processor(input_ids, next_token_logits)
77
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 97, in __call__
78
- 2024-07-11 22:34:13 | ERROR | stderr | scores = processor(input_ids, scores)
79
- 2024-07-11 22:34:13 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 333, in __call__
80
- 2024-07-11 22:34:13 | ERROR | stderr | score = torch.gather(scores, 1, input_ids)
81
- 2024-07-11 22:34:13 | ERROR | stderr | RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:4 and cuda:0! (when checking argument for argument index in method wrapper_CUDA_gather)
82
- 2024-07-11 22:34:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
83
- 2024-07-11 22:34:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_113f24.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_113f24.log.2024-07-10 DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_119769.log DELETED
@@ -1,175 +0,0 @@
1
- 2024-07-10 17:35:06 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40005, worker_address='http://10.140.60.25:40005', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-26B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 17:35:06 | INFO | model_worker | Loading the model InternVL2-26B on worker 119769 ...
3
- 2024-07-10 17:35:06 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 17:35:06 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 17:35:09 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 17:35:09 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 17:35:10 | ERROR | stderr |
8
- 2024-07-10 17:35:21 | ERROR | stderr |
9
- 2024-07-10 17:35:33 | ERROR | stderr |
10
- 2024-07-10 17:35:42 | ERROR | stderr |
11
- 2024-07-10 17:35:50 | ERROR | stderr |
12
- 2024-07-10 17:35:59 | ERROR | stderr |
13
- 2024-07-10 17:36:09 | ERROR | stderr |
14
- 2024-07-10 17:36:18 | ERROR | stderr |
15
- 2024-07-10 17:36:25 | ERROR | stderr |
16
- 2024-07-10 17:36:32 | ERROR | stderr |
17
- 2024-07-10 17:36:39 | ERROR | stderr |
18
- 2024-07-10 17:36:43 | ERROR | stderr |
19
- 2024-07-10 17:36:43 | ERROR | stderr |
20
- 2024-07-10 17:36:43 | ERROR | stderr |
21
- 2024-07-10 17:37:07 | INFO | model_worker | Register to controller
22
- 2024-07-10 17:37:07 | ERROR | stderr | INFO: Started server process [5180]
23
- 2024-07-10 17:37:07 | ERROR | stderr | INFO: Waiting for application startup.
24
- 2024-07-10 17:37:07 | ERROR | stderr | INFO: Application startup complete.
25
- 2024-07-10 17:37:07 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40005 (Press CTRL+C to quit)
26
- 2024-07-10 17:37:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: None. global_counter: 0
27
- 2024-07-10 17:37:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: None. global_counter: 0
28
- 2024-07-10 17:37:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: None. global_counter: 0
29
- 2024-07-10 17:38:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: None. global_counter: 0
30
- 2024-07-10 17:38:15 | INFO | stdout | INFO: 10.140.60.209:59250 - "POST /worker_get_status HTTP/1.1" 200 OK
31
- 2024-07-10 17:38:17 | INFO | stdout | INFO: 10.140.60.209:59320 - "POST /worker_get_status HTTP/1.1" 200 OK
32
- 2024-07-10 17:38:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: None. global_counter: 0
33
- 2024-07-10 17:38:26 | INFO | stdout | INFO: 10.140.60.209:59364 - "POST /worker_get_status HTTP/1.1" 200 OK
34
- 2024-07-10 17:38:29 | INFO | stdout | INFO: 10.140.60.209:59380 - "POST /worker_get_status HTTP/1.1" 200 OK
35
- 2024-07-10 17:38:30 | INFO | stdout | INFO: 10.140.60.209:59394 - "POST /worker_get_status HTTP/1.1" 200 OK
36
- 2024-07-10 17:38:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
37
- 2024-07-10 17:38:33 | INFO | stdout | INFO: 10.140.60.209:59400 - "POST /worker_generate_stream HTTP/1.1" 200 OK
38
- 2024-07-10 17:38:33 | INFO | stdout | history: []
39
- 2024-07-10 17:38:33 | INFO | stdout | question: Image-1: <image>
40
- 2024-07-10 17:38:33 | INFO | stdout | 这是��
41
- 2024-07-10 17:38:33 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FA89C5BC370>]
42
- 2024-07-10 17:38:33 | INFO | model_worker | dynamic_image_size: True
43
- 2024-07-10 17:38:33 | INFO | model_worker | use_thumbnail: True
44
- 2024-07-10 17:38:34 | INFO | model_worker | Resize images to 448x448
45
- 2024-07-10 17:38:34 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
46
- 2024-07-10 17:38:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
47
- 2024-07-10 17:38:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
48
- 2024-07-10 17:38:50 | INFO | stdout | INFO: 10.140.60.209:59418 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-10 17:38:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
50
- 2024-07-10 17:38:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
51
- 2024-07-10 17:38:53 | INFO | stdout | INFO: 10.140.60.209:59424 - "POST /worker_generate_stream HTTP/1.1" 200 OK
52
- 2024-07-10 17:38:53 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一杯饮料，放在一个透明的玻璃杯里，杯子上印有“AURORA GLASS”字样。杯子里有冰块，周围也散落着几块冰块。背景中有一盆绿色的植物，放在一个白色的花盆里。饮料可能是某种碳酸饮料，比如啤酒或汽水，但具体种类无法确定。 ']]
53
- 2024-07-10 17:38:53 | INFO | stdout | question: 根据图片写一篇800字的作文
54
- 2024-07-10 17:38:53 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FA89C482E00>]
55
- 2024-07-10 17:38:53 | INFO | model_worker | dynamic_image_size: True
56
- 2024-07-10 17:38:53 | INFO | model_worker | use_thumbnail: True
57
- 2024-07-10 17:38:54 | INFO | model_worker | Resize images to 448x448
58
- 2024-07-10 17:38:54 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
59
- 2024-07-10 17:39:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
60
- 2024-07-10 17:39:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
61
- 2024-07-10 17:39:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
62
- 2024-07-10 17:39:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
63
- 2024-07-10 17:39:42 | INFO | stdout | INFO: 10.140.60.209:59622 - "POST /worker_get_status HTTP/1.1" 200 OK
64
- 2024-07-10 17:39:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
65
- 2024-07-10 17:40:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
66
- 2024-07-10 17:40:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
67
- 2024-07-10 17:40:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
68
- 2024-07-10 17:40:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
69
- 2024-07-10 17:41:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
70
- 2024-07-10 17:41:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
71
- 2024-07-10 17:41:31 | INFO | stdout | INFO: 10.140.60.209:60036 - "POST /worker_get_status HTTP/1.1" 200 OK
72
- 2024-07-10 17:41:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
73
- 2024-07-10 17:41:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
74
- 2024-07-10 17:42:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
75
- 2024-07-10 17:42:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
76
- 2024-07-10 17:42:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
77
- 2024-07-10 17:42:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
78
- 2024-07-10 17:43:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
79
- 2024-07-10 17:43:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
80
- 2024-07-10 17:43:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
81
- 2024-07-10 17:43:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
82
- 2024-07-10 17:44:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
83
- 2024-07-10 17:44:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
84
- 2024-07-10 17:44:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
85
- 2024-07-10 17:44:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
86
- 2024-07-10 17:45:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
87
- 2024-07-10 17:45:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
88
- 2024-07-10 17:45:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
89
- 2024-07-10 17:45:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
90
- 2024-07-10 17:46:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
91
- 2024-07-10 17:46:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
92
- 2024-07-10 17:46:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
93
- 2024-07-10 17:46:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
94
- 2024-07-10 17:47:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
95
- 2024-07-10 17:47:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
96
- 2024-07-10 17:47:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
97
- 2024-07-10 17:47:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
98
- 2024-07-10 17:48:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
99
- 2024-07-10 17:48:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
100
- 2024-07-10 17:48:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
101
- 2024-07-10 17:48:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
102
- 2024-07-10 17:49:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
103
- 2024-07-10 17:49:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
104
- 2024-07-10 17:49:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
105
- 2024-07-10 17:49:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
106
- 2024-07-10 17:50:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
107
- 2024-07-10 17:50:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
108
- 2024-07-10 17:50:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
109
- 2024-07-10 17:50:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
110
- 2024-07-10 17:51:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
111
- 2024-07-10 17:51:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
112
- 2024-07-10 17:51:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
113
- 2024-07-10 17:51:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
114
- 2024-07-10 17:52:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
115
- 2024-07-10 17:52:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
116
- 2024-07-10 17:52:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
117
- 2024-07-10 17:52:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
118
- 2024-07-10 17:53:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
119
- 2024-07-10 17:53:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
120
- 2024-07-10 17:53:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
121
- 2024-07-10 17:53:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
122
- 2024-07-10 17:54:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
123
- 2024-07-10 17:54:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
124
- 2024-07-10 17:54:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
125
- 2024-07-10 17:54:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
126
- 2024-07-10 17:55:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
127
- 2024-07-10 17:55:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
128
- 2024-07-10 17:55:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
129
- 2024-07-10 17:55:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
130
- 2024-07-10 17:56:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
131
- 2024-07-10 17:56:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
132
- 2024-07-10 17:56:33 | INFO | stdout | INFO: 10.140.60.209:35500 - "POST /worker_get_status HTTP/1.1" 200 OK
133
- 2024-07-10 17:56:36 | INFO | stdout | INFO: 10.140.60.209:35522 - "POST /worker_get_status HTTP/1.1" 200 OK
134
- 2024-07-10 17:56:37 | INFO | stdout | INFO: 10.140.60.209:35540 - "POST /worker_get_status HTTP/1.1" 200 OK
135
- 2024-07-10 17:56:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
136
- 2024-07-10 17:56:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
137
- 2024-07-10 17:57:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
138
- 2024-07-10 17:57:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
139
- 2024-07-10 17:57:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
140
- 2024-07-10 17:57:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
141
- 2024-07-10 17:58:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
142
- 2024-07-10 17:58:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
143
- 2024-07-10 17:58:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
144
- 2024-07-10 17:58:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
145
- 2024-07-10 17:59:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
146
- 2024-07-10 17:59:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
147
- 2024-07-10 17:59:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
148
- 2024-07-10 17:59:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
149
- 2024-07-10 18:00:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
150
- 2024-07-10 18:00:15 | INFO | stdout | INFO: 10.140.60.209:36335 - "POST /worker_get_status HTTP/1.1" 200 OK
151
- 2024-07-10 18:00:18 | INFO | stdout | INFO: 10.140.60.209:36414 - "POST /worker_get_status HTTP/1.1" 200 OK
152
- 2024-07-10 18:00:19 | INFO | stdout | INFO: 10.140.60.209:36432 - "POST /worker_get_status HTTP/1.1" 200 OK
153
- 2024-07-10 18:00:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
154
- 2024-07-10 18:00:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
155
- 2024-07-10 18:00:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
156
- 2024-07-10 18:01:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
157
- 2024-07-10 18:01:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
158
- 2024-07-10 18:01:30 | INFO | stdout | INFO: 10.140.60.209:36650 - "POST /worker_get_status HTTP/1.1" 200 OK
159
- 2024-07-10 18:01:33 | INFO | stdout | INFO: 10.140.60.209:36664 - "POST /worker_get_status HTTP/1.1" 200 OK
160
- 2024-07-10 18:01:36 | INFO | stdout | INFO: 10.140.60.209:36680 - "POST /worker_get_status HTTP/1.1" 200 OK
161
- 2024-07-10 18:01:38 | INFO | stdout | INFO: 10.140.60.209:36696 - "POST /worker_get_status HTTP/1.1" 200 OK
162
- 2024-07-10 18:01:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
163
- 2024-07-10 18:01:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
164
- 2024-07-10 18:02:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
165
- 2024-07-10 18:02:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
166
- 2024-07-10 18:02:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
167
- 2024-07-10 18:02:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
168
- 2024-07-10 18:03:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
169
- 2024-07-10 18:03:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
170
- 2024-07-10 18:03:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
171
- 2024-07-10 18:03:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
172
- 2024-07-10 18:04:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
173
- 2024-07-10 18:04:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
174
- 2024-07-10 18:04:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
175
- 2024-07-10 18:04:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-26B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_131934.log DELETED
@@ -1,78 +0,0 @@
1
- 2024-07-11 22:39:38 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.66.196:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-78B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:39:38 | INFO | model_worker | Loading the model InternVL2-78B on worker 131934 ...
3
- 2024-07-11 22:39:38 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:39:38 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:39:43 | ERROR | stderr |
6
- 2024-07-11 22:39:45 | ERROR | stderr |
7
- 2024-07-11 22:39:47 | ERROR | stderr |
8
- 2024-07-11 22:39:49 | ERROR | stderr |
9
- 2024-07-11 22:39:51 | ERROR | stderr |
10
- 2024-07-11 22:39:53 | ERROR | stderr |
11
- 2024-07-11 22:39:55 | ERROR | stderr |
12
- 2024-07-11 22:39:57 | ERROR | stderr |
13
- 2024-07-11 22:39:59 | ERROR | stderr |
14
- 2024-07-11 22:40:01 | ERROR | stderr |
15
- 2024-07-11 22:40:03 | ERROR | stderr |
16
- 2024-07-11 22:40:05 | ERROR | stderr |
17
- 2024-07-11 22:40:07 | ERROR | stderr |
18
- 2024-07-11 22:40:09 | ERROR | stderr |
19
- 2024-07-11 22:40:11 | ERROR | stderr |
20
- 2024-07-11 22:40:13 | ERROR | stderr |
21
- 2024-07-11 22:40:15 | ERROR | stderr |
22
- 2024-07-11 22:40:17 | ERROR | stderr |
23
- 2024-07-11 22:40:19 | ERROR | stderr |
24
- 2024-07-11 22:40:21 | ERROR | stderr |
25
- 2024-07-11 22:40:23 | ERROR | stderr |
26
- 2024-07-11 22:40:25 | ERROR | stderr |
27
- 2024-07-11 22:40:27 | ERROR | stderr |
28
- 2024-07-11 22:40:29 | ERROR | stderr |
29
- 2024-07-11 22:40:31 | ERROR | stderr |
30
- 2024-07-11 22:40:33 | ERROR | stderr |
31
- 2024-07-11 22:40:36 | ERROR | stderr |
32
- 2024-07-11 22:40:38 | ERROR | stderr |
33
- 2024-07-11 22:40:39 | ERROR | stderr |
34
- 2024-07-11 22:40:42 | ERROR | stderr |
35
- 2024-07-11 22:40:44 | ERROR | stderr |
36
- 2024-07-11 22:40:46 | ERROR | stderr |
37
- 2024-07-11 22:40:48 | ERROR | stderr |
38
- 2024-07-11 22:40:49 | ERROR | stderr |
39
- 2024-07-11 22:40:49 | ERROR | stderr |
40
- 2024-07-11 22:40:49 | ERROR | stderr |
41
- 2024-07-11 22:40:50 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:40:50 | ERROR | stderr | INFO: Started server process [58685]
43
- 2024-07-11 22:40:50 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:40:50 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:40:50 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40007 (Press CTRL+C to quit)
46
- 2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:47870 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:47890 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:47910 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-11 22:41:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
50
- 2024-07-11 22:41:02 | INFO | stdout | INFO: 10.140.60.209:47916 - "POST /worker_generate_stream HTTP/1.1" 200 OK
51
- 2024-07-11 22:41:02 | INFO | model_worker | max_input_tile_list: [12]
52
- 2024-07-11 22:41:02 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
53
- 2024-07-11 22:41:02 | INFO | model_worker | []
54
- 2024-07-11 22:41:02 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7f444c215240>}
55
- 2024-07-11 22:41:03 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
56
- 2024-07-11 22:41:03 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
57
- 2024-07-11 22:41:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
58
- 2024-07-11 22:41:09 | ERROR | stderr | Exception in thread Thread-3 (chat):
59
- 2024-07-11 22:41:09 | ERROR | stderr | Traceback (most recent call last):
60
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
61
- 2024-07-11 22:41:09 | ERROR | stderr | self.run()
62
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 946, in run
63
- 2024-07-11 22:41:09 | ERROR | stderr | self._target(*self._args, **self._kwargs)
64
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 283, in chat
65
- 2024-07-11 22:41:09 | ERROR | stderr | generation_output = self.generate(
66
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
67
- 2024-07-11 22:41:09 | ERROR | stderr | return func(*args, **kwargs)
68
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 333, in generate
69
- 2024-07-11 22:41:09 | ERROR | stderr | outputs = self.language_model.generate(
70
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
71
- 2024-07-11 22:41:09 | ERROR | stderr | return func(*args, **kwargs)
72
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 1525, in generate
73
- 2024-07-11 22:41:09 | ERROR | stderr | return self.sample(
74
- 2024-07-11 22:41:09 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 2641, in sample
75
- 2024-07-11 22:41:09 | ERROR | stderr | next_token_scores = logits_processor(input_ids, next_token_logits.to(input_ids.devices))
76
- 2024-07-11 22:41:09 | ERROR | stderr | AttributeError: 'Tensor' object has no attribute 'devices'. Did you mean: 'device'?
77
- 2024-07-11 22:41:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
78
- 2024-07-11 22:41:15 | ERROR | stderr | INFO: Shutting down
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_1380b0.log DELETED
@@ -1,115 +0,0 @@
1
- 2024-07-11 22:15:24 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40006, worker_address='http://10.140.60.25:40006', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-40B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:15:24 | INFO | model_worker | Loading the model InternVL2-40B on worker 1380b0 ...
3
- 2024-07-11 22:15:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:15:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:15:30 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-11 22:15:30 | ERROR | stderr | warnings.warn(
7
- 2024-07-11 22:15:33 | ERROR | stderr |
8
- 2024-07-11 22:15:35 | ERROR | stderr |
9
- 2024-07-11 22:15:37 | ERROR | stderr |
10
- 2024-07-11 22:15:39 | ERROR | stderr |
11
- 2024-07-11 22:15:41 | ERROR | stderr |
12
- 2024-07-11 22:15:43 | ERROR | stderr |
13
- 2024-07-11 22:15:45 | ERROR | stderr |
14
- 2024-07-11 22:15:47 | ERROR | stderr |
15
- 2024-07-11 22:15:49 | ERROR | stderr |
16
- 2024-07-11 22:15:51 | ERROR | stderr |
17
- 2024-07-11 22:15:53 | ERROR | stderr |
18
- 2024-07-11 22:15:55 | ERROR | stderr |
19
- 2024-07-11 22:15:58 | ERROR | stderr |
20
- 2024-07-11 22:16:00 | ERROR | stderr |
21
- 2024-07-11 22:16:02 | ERROR | stderr |
22
- 2024-07-11 22:16:04 | ERROR | stderr |
23
- 2024-07-11 22:16:07 | ERROR | stderr |
24
- 2024-07-11 22:16:08 | ERROR | stderr |
25
- 2024-07-11 22:16:08 | ERROR | stderr |
26
- 2024-07-11 22:16:08 | ERROR | stderr |
27
- 2024-07-11 22:16:08 | INFO | model_worker | Register to controller
28
- 2024-07-11 22:16:08 | ERROR | stderr | INFO: Started server process [50195]
29
- 2024-07-11 22:16:08 | ERROR | stderr | INFO: Waiting for application startup.
30
- 2024-07-11 22:16:08 | ERROR | stderr | INFO: Application startup complete.
31
- 2024-07-11 22:16:08 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40006 (Press CTRL+C to quit)
32
- 2024-07-11 22:16:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
33
- 2024-07-11 22:16:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
34
- 2024-07-11 22:16:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
35
- 2024-07-11 22:17:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
36
- 2024-07-11 22:17:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
37
- 2024-07-11 22:17:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
38
- 2024-07-11 22:17:49 | INFO | stdout | INFO: 10.140.60.209:42548 - "POST /worker_get_status HTTP/1.1" 200 OK
39
- 2024-07-11 22:17:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
40
- 2024-07-11 22:18:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
41
- 2024-07-11 22:18:08 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f60a42b60e0>: Failed to establish a new connection: [Errno 111] Connection refused'))
42
- 2024-07-11 22:18:13 | INFO | model_worker | Register to controller
43
- 2024-07-11 22:18:17 | INFO | stdout | INFO: 10.140.60.209:42746 - "POST /worker_get_status HTTP/1.1" 200 OK
44
- 2024-07-11 22:18:21 | INFO | stdout | INFO: 10.140.60.209:42872 - "POST /worker_get_status HTTP/1.1" 200 OK
45
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:42892 - "POST /worker_get_status HTTP/1.1" 200 OK
46
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:42912 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-11 22:18:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
48
- 2024-07-11 22:18:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
49
- 2024-07-11 22:18:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
50
- 2024-07-11 22:19:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
51
- 2024-07-11 22:19:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:43356 - "POST /worker_get_status HTTP/1.1" 200 OK
53
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:43372 - "POST /worker_get_status HTTP/1.1" 200 OK
54
- 2024-07-11 22:19:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:19:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
56
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:43468 - "POST /worker_get_status HTTP/1.1" 200 OK
57
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:43487 - "POST /worker_get_status HTTP/1.1" 200 OK
58
- 2024-07-11 22:20:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
59
- 2024-07-11 22:20:00 | INFO | stdout | INFO: 10.140.60.209:43492 - "POST /worker_generate_stream HTTP/1.1" 200 OK
60
- 2024-07-11 22:20:00 | INFO | model_worker | max_input_tile_list: [12]
61
- 2024-07-11 22:20:00 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
62
- 2024-07-11 22:20:00 | INFO | model_worker | []
63
- 2024-07-11 22:20:00 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7f60a430a050>}
64
- 2024-07-11 22:20:02 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
65
- 2024-07-11 22:20:05 | ERROR | stderr | Exception in thread Thread-3 (chat):
66
- 2024-07-11 22:20:05 | ERROR | stderr | Traceback (most recent call last):
67
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
68
- 2024-07-11 22:20:05 | ERROR | stderr | self.run()
69
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/threading.py", line 946, in run
70
- 2024-07-11 22:20:05 | ERROR | stderr | self._target(*self._args, **self._kwargs)
71
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-40B/modeling_internvl_chat.py", line 280, in chat
72
- 2024-07-11 22:20:05 | ERROR | stderr | generation_output = self.generate(
73
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
74
- 2024-07-11 22:20:05 | ERROR | stderr | return func(*args, **kwargs)
75
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-40B/modeling_internvl_chat.py", line 330, in generate
76
- 2024-07-11 22:20:05 | ERROR | stderr | outputs = self.language_model.generate(
77
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
78
- 2024-07-11 22:20:05 | ERROR | stderr | return func(*args, **kwargs)
79
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/utils.py", line 1525, in generate
80
- 2024-07-11 22:20:05 | ERROR | stderr | return self.sample(
81
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/utils.py", line 2641, in sample
82
- 2024-07-11 22:20:05 | ERROR | stderr | next_token_scores = logits_processor(input_ids, next_token_logits)
83
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 97, in __call__
84
- 2024-07-11 22:20:05 | ERROR | stderr | scores = processor(input_ids, scores)
85
- 2024-07-11 22:20:05 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 333, in __call__
86
- 2024-07-11 22:20:05 | ERROR | stderr | score = torch.gather(scores, 1, input_ids)
87
- 2024-07-11 22:20:05 | ERROR | stderr | RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:2 and cuda:0! (when checking argument for argument index in method wrapper_CUDA_gather)
88
- 2024-07-11 22:20:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
89
- 2024-07-11 22:20:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
90
- 2024-07-11 22:20:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
91
- 2024-07-11 22:20:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
92
- 2024-07-11 22:20:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
93
- 2024-07-11 22:21:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
94
- 2024-07-11 22:21:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
95
- 2024-07-11 22:21:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
96
- 2024-07-11 22:21:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
97
- 2024-07-11 22:22:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
98
- 2024-07-11 22:22:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
99
- 2024-07-11 22:22:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
100
- 2024-07-11 22:22:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
101
- 2024-07-11 22:23:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
102
- 2024-07-11 22:23:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
103
- 2024-07-11 22:23:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
104
- 2024-07-11 22:23:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
105
- 2024-07-11 22:24:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
106
- 2024-07-11 22:24:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
107
- 2024-07-11 22:24:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
108
- 2024-07-11 22:24:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
109
- 2024-07-11 22:25:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
110
- 2024-07-11 22:25:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
111
- 2024-07-11 22:25:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
112
- 2024-07-11 22:25:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
113
- 2024-07-11 22:26:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
114
- 2024-07-11 22:26:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
115
- 2024-07-11 22:26:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_19edde.log DELETED
@@ -1,43 +0,0 @@
1
- 2024-07-10 04:41:59 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 04:41:59 | INFO | model_worker | Loading the model InternVL2-1B on worker 19edde ...
3
- 2024-07-10 04:41:59 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 04:41:59 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 04:42:01 | INFO | model_worker | Register to controller
6
- 2024-07-10 04:42:01 | ERROR | stderr | INFO: Started server process [99741]
7
- 2024-07-10 04:42:01 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 04:42:01 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 04:42:01 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 04:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
11
- 2024-07-10 04:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
12
- 2024-07-10 04:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
13
- 2024-07-10 04:43:00 | INFO | stdout | INFO: 10.140.60.209:55826 - "POST /worker_get_status HTTP/1.1" 200 OK
14
- 2024-07-10 04:43:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
15
- 2024-07-10 04:43:15 | INFO | stdout | INFO: 10.140.60.209:55900 - "POST /worker_get_status HTTP/1.1" 200 OK
16
- 2024-07-10 04:43:16 | INFO | stdout | INFO: 10.140.60.209:55938 - "POST /worker_get_status HTTP/1.1" 200 OK
17
- 2024-07-10 04:43:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
18
- 2024-07-10 04:43:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
19
- 2024-07-10 04:43:17 | INFO | stdout | INFO: 10.140.60.209:55960 - "POST /worker_generate_stream HTTP/1.1" 200 OK
20
- 2024-07-10 04:43:17 | INFO | stdout | history: []
21
- 2024-07-10 04:43:17 | INFO | stdout | question: Image-1: <image>
22
- 2024-07-10 04:43:17 | INFO | stdout | Describe this image in detail.
23
- 2024-07-10 04:43:17 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F5138388130>]
24
- 2024-07-10 04:43:17 | INFO | model_worker | dynamic_image_size: True
25
- 2024-07-10 04:43:17 | INFO | model_worker | use_thumbnail: True
26
- 2024-07-10 04:43:17 | INFO | model_worker | Resize images to 448x448
27
- 2024-07-10 04:43:17 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
28
- 2024-07-10 04:43:17 | ERROR | stderr | Exception in thread Thread-2 (chat):
29
- 2024-07-10 04:43:17 | ERROR | stderr | Traceback (most recent call last):
30
- 2024-07-10 04:43:17 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
31
- 2024-07-10 04:43:18 | ERROR | stderr | self.run()
32
- 2024-07-10 04:43:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 946, in run
33
- 2024-07-10 04:43:18 | ERROR | stderr | self._target(*self._args, **self._kwargs)
34
- 2024-07-10 04:43:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-1B/modeling_internvl_chat.py", line 280, in chat
35
- 2024-07-10 04:43:18 | ERROR | stderr | generation_output = self.generate(
36
- 2024-07-10 04:43:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
37
- 2024-07-10 04:43:18 | ERROR | stderr | return func(*args, **kwargs)
38
- 2024-07-10 04:43:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-1B/modeling_internvl_chat.py", line 330, in generate
39
- 2024-07-10 04:43:18 | ERROR | stderr | outputs = self.language_model.generate(
40
- 2024-07-10 04:43:18 | ERROR | stderr | TypeError: transformers.generation.utils.GenerationMixin.generate() got multiple values for keyword argument 'use_cache'
41
- 2024-07-10 04:43:27 | INFO | stdout | Caught Unknown Error
42
- 2024-07-10 04:43:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
43
- 2024-07-10 04:43:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_1abcda.log DELETED
@@ -1,154 +0,0 @@
1
- 2024-07-10 17:34:51 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40004, worker_address='http://10.140.60.25:40004', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-8B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 17:34:51 | INFO | model_worker | Loading the model InternVL2-8B on worker 1abcda ...
3
- 2024-07-10 17:34:52 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 17:34:52 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 17:34:53 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 17:34:53 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 17:34:53 | ERROR | stderr |
8
- 2024-07-10 17:35:05 | ERROR | stderr |
9
- 2024-07-10 17:35:16 | ERROR | stderr |
10
- 2024-07-10 17:35:26 | ERROR | stderr |
11
- 2024-07-10 17:35:29 | ERROR | stderr |
12
- 2024-07-10 17:35:29 | ERROR | stderr |
13
- 2024-07-10 17:35:29 | ERROR | stderr |
14
- 2024-07-10 17:35:46 | INFO | model_worker | Register to controller
15
- 2024-07-10 17:35:46 | ERROR | stderr | INFO: Started server process [4949]
16
- 2024-07-10 17:35:46 | ERROR | stderr | INFO: Waiting for application startup.
17
- 2024-07-10 17:35:46 | ERROR | stderr | INFO: Application startup complete.
18
- 2024-07-10 17:35:46 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40004 (Press CTRL+C to quit)
19
- 2024-07-10 17:36:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
20
- 2024-07-10 17:36:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
21
- 2024-07-10 17:36:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
22
- 2024-07-10 17:36:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
23
- 2024-07-10 17:37:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
24
- 2024-07-10 17:37:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
25
- 2024-07-10 17:37:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
26
- 2024-07-10 17:37:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
27
- 2024-07-10 17:38:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
28
- 2024-07-10 17:38:15 | INFO | stdout | INFO: 10.140.60.209:33782 - "POST /worker_get_status HTTP/1.1" 200 OK
29
- 2024-07-10 17:38:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
30
- 2024-07-10 17:38:17 | INFO | stdout | INFO: 10.140.60.209:33852 - "POST /worker_get_status HTTP/1.1" 200 OK
31
- 2024-07-10 17:38:26 | INFO | stdout | INFO: 10.140.60.209:33896 - "POST /worker_get_status HTTP/1.1" 200 OK
32
- 2024-07-10 17:38:29 | INFO | stdout | INFO: 10.140.60.209:33912 - "POST /worker_get_status HTTP/1.1" 200 OK
33
- 2024-07-10 17:38:30 | INFO | stdout | INFO: 10.140.60.209:33927 - "POST /worker_get_status HTTP/1.1" 200 OK
34
- 2024-07-10 17:38:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
35
- 2024-07-10 17:38:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
36
- 2024-07-10 17:38:50 | INFO | stdout | INFO: 10.140.60.209:33950 - "POST /worker_get_status HTTP/1.1" 200 OK
37
- 2024-07-10 17:39:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
38
- 2024-07-10 17:39:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
39
- 2024-07-10 17:39:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
40
- 2024-07-10 17:39:42 | INFO | stdout | INFO: 10.140.60.209:34154 - "POST /worker_get_status HTTP/1.1" 200 OK
41
- 2024-07-10 17:39:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
42
- 2024-07-10 17:40:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
43
- 2024-07-10 17:40:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
44
- 2024-07-10 17:40:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
45
- 2024-07-10 17:40:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
46
- 2024-07-10 17:41:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
47
- 2024-07-10 17:41:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
48
- 2024-07-10 17:41:31 | INFO | stdout | INFO: 10.140.60.209:34568 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-10 17:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
50
- 2024-07-10 17:41:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
51
- 2024-07-10 17:42:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
52
- 2024-07-10 17:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
53
- 2024-07-10 17:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
54
- 2024-07-10 17:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
55
- 2024-07-10 17:43:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
56
- 2024-07-10 17:43:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
57
- 2024-07-10 17:43:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
58
- 2024-07-10 17:43:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
59
- 2024-07-10 17:44:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
60
- 2024-07-10 17:44:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
61
- 2024-07-10 17:44:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
62
- 2024-07-10 17:44:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
63
- 2024-07-10 17:45:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
64
- 2024-07-10 17:45:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
65
- 2024-07-10 17:45:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
66
- 2024-07-10 17:45:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
67
- 2024-07-10 17:46:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
68
- 2024-07-10 17:46:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
69
- 2024-07-10 17:46:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
70
- 2024-07-10 17:46:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
71
- 2024-07-10 17:47:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
72
- 2024-07-10 17:47:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
73
- 2024-07-10 17:47:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
74
- 2024-07-10 17:47:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
75
- 2024-07-10 17:48:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
76
- 2024-07-10 17:48:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
77
- 2024-07-10 17:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
78
- 2024-07-10 17:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
79
- 2024-07-10 17:49:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
80
- 2024-07-10 17:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
81
- 2024-07-10 17:49:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
82
- 2024-07-10 17:49:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
83
- 2024-07-10 17:50:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
84
- 2024-07-10 17:50:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
85
- 2024-07-10 17:50:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
86
- 2024-07-10 17:50:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
87
- 2024-07-10 17:51:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
88
- 2024-07-10 17:51:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
89
- 2024-07-10 17:51:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
90
- 2024-07-10 17:51:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
91
- 2024-07-10 17:52:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
92
- 2024-07-10 17:52:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
93
- 2024-07-10 17:52:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
94
- 2024-07-10 17:52:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
95
- 2024-07-10 17:53:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
96
- 2024-07-10 17:53:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
97
- 2024-07-10 17:53:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
98
- 2024-07-10 17:53:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
99
- 2024-07-10 17:54:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
100
- 2024-07-10 17:54:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
101
- 2024-07-10 17:54:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
102
- 2024-07-10 17:54:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
103
- 2024-07-10 17:55:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
104
- 2024-07-10 17:55:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
105
- 2024-07-10 17:55:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
106
- 2024-07-10 17:55:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
107
- 2024-07-10 17:56:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
108
- 2024-07-10 17:56:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
109
- 2024-07-10 17:56:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
110
- 2024-07-10 17:56:33 | INFO | stdout | INFO: 10.140.60.209:38264 - "POST /worker_get_status HTTP/1.1" 200 OK
111
- 2024-07-10 17:56:36 | INFO | stdout | INFO: 10.140.60.209:38286 - "POST /worker_get_status HTTP/1.1" 200 OK
112
- 2024-07-10 17:56:37 | INFO | stdout | INFO: 10.140.60.209:38304 - "POST /worker_get_status HTTP/1.1" 200 OK
113
- 2024-07-10 17:56:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
114
- 2024-07-10 17:57:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
115
- 2024-07-10 17:57:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
116
- 2024-07-10 17:57:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
117
- 2024-07-10 17:57:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
118
- 2024-07-10 17:58:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
119
- 2024-07-10 17:58:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
120
- 2024-07-10 17:58:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
121
- 2024-07-10 17:58:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
122
- 2024-07-10 17:59:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
123
- 2024-07-10 17:59:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
124
- 2024-07-10 17:59:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
125
- 2024-07-10 17:59:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
126
- 2024-07-10 18:00:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
127
- 2024-07-10 18:00:15 | INFO | stdout | INFO: 10.140.60.209:39098 - "POST /worker_get_status HTTP/1.1" 200 OK
128
- 2024-07-10 18:00:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
129
- 2024-07-10 18:00:18 | INFO | stdout | INFO: 10.140.60.209:39178 - "POST /worker_get_status HTTP/1.1" 200 OK
130
- 2024-07-10 18:00:19 | INFO | stdout | INFO: 10.140.60.209:39196 - "POST /worker_get_status HTTP/1.1" 200 OK
131
- 2024-07-10 18:00:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
132
- 2024-07-10 18:00:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
133
- 2024-07-10 18:01:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
134
- 2024-07-10 18:01:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
135
- 2024-07-10 18:01:30 | INFO | stdout | INFO: 10.140.60.209:39414 - "POST /worker_get_status HTTP/1.1" 200 OK
136
- 2024-07-10 18:01:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
137
- 2024-07-10 18:01:33 | INFO | stdout | INFO: 10.140.60.209:39428 - "POST /worker_get_status HTTP/1.1" 200 OK
138
- 2024-07-10 18:01:36 | INFO | stdout | INFO: 10.140.60.209:39444 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-10 18:01:38 | INFO | stdout | INFO: 10.140.60.209:39460 - "POST /worker_get_status HTTP/1.1" 200 OK
140
- 2024-07-10 18:01:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
141
- 2024-07-10 18:02:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
142
- 2024-07-10 18:02:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
143
- 2024-07-10 18:02:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
144
- 2024-07-10 18:02:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
145
- 2024-07-10 18:03:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
146
- 2024-07-10 18:03:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
147
- 2024-07-10 18:03:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
148
- 2024-07-10 18:03:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
149
- 2024-07-10 18:04:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
150
- 2024-07-10 18:04:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
151
- 2024-07-10 18:04:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
152
- 2024-07-10 18:04:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
153
- 2024-07-10 18:05:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
154
- 2024-07-10 18:05:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_1c4fbd.log DELETED
@@ -1,55 +0,0 @@
1
- 2024-07-11 22:32:31 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40008, worker_address='http://10.140.60.182:40008', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-Pro/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:32:31 | INFO | model_worker | Loading the model InternVL2-Pro on worker 1c4fbd ...
3
- 2024-07-11 22:32:31 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:32:31 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:32:35 | ERROR | stderr |
6
- 2024-07-11 22:32:37 | ERROR | stderr |
7
- 2024-07-11 22:32:40 | ERROR | stderr |
8
- 2024-07-11 22:32:43 | ERROR | stderr |
9
- 2024-07-11 22:32:45 | ERROR | stderr |
10
- 2024-07-11 22:32:48 | ERROR | stderr |
11
- 2024-07-11 22:32:51 | ERROR | stderr |
12
- 2024-07-11 22:32:53 | ERROR | stderr |
13
- 2024-07-11 22:32:55 | ERROR | stderr |
14
- 2024-07-11 22:32:57 | ERROR | stderr |
15
- 2024-07-11 22:32:59 | ERROR | stderr |
16
- 2024-07-11 22:33:01 | ERROR | stderr |
17
- 2024-07-11 22:33:03 | ERROR | stderr |
18
- 2024-07-11 22:33:05 | ERROR | stderr |
19
- 2024-07-11 22:33:07 | ERROR | stderr |
20
- 2024-07-11 22:33:09 | ERROR | stderr |
21
- 2024-07-11 22:33:11 | ERROR | stderr |
22
- 2024-07-11 22:33:13 | ERROR | stderr |
23
- 2024-07-11 22:33:15 | ERROR | stderr |
24
- 2024-07-11 22:33:17 | ERROR | stderr |
25
- 2024-07-11 22:33:19 | ERROR | stderr |
26
- 2024-07-11 22:33:21 | ERROR | stderr |
27
- 2024-07-11 22:33:23 | ERROR | stderr |
28
- 2024-07-11 22:33:25 | ERROR | stderr |
29
- 2024-07-11 22:33:27 | ERROR | stderr |
30
- 2024-07-11 22:33:28 | ERROR | stderr |
31
- 2024-07-11 22:33:30 | ERROR | stderr |
32
- 2024-07-11 22:33:32 | ERROR | stderr |
33
- 2024-07-11 22:33:34 | ERROR | stderr |
34
- 2024-07-11 22:33:36 | ERROR | stderr |
35
- 2024-07-11 22:33:37 | ERROR | stderr |
36
- 2024-07-11 22:33:39 | ERROR | stderr |
37
- 2024-07-11 22:33:41 | ERROR | stderr |
38
- 2024-07-11 22:33:42 | ERROR | stderr |
39
- 2024-07-11 22:33:42 | ERROR | stderr |
40
- 2024-07-11 22:33:42 | ERROR | stderr |
41
- 2024-07-11 22:33:43 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:33:43 | ERROR | stderr | INFO: Started server process [13199]
43
- 2024-07-11 22:33:43 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:33:43 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:33:43 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40008 (Press CTRL+C to quit)
46
- 2024-07-11 22:33:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
47
- 2024-07-11 22:34:02 | INFO | stdout | INFO: 10.140.60.209:45980 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:34:04 | INFO | stdout | INFO: 10.140.60.209:46001 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:46020 - "POST /worker_get_status HTTP/1.1" 200 OK
50
- 2024-07-11 22:34:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
51
- 2024-07-11 22:34:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:34:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
53
- 2024-07-11 22:34:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
54
- 2024-07-11 22:35:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:35:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_1c9f40.log DELETED
@@ -1,47 +0,0 @@
1
- 2024-07-10 18:00:50 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40006, worker_address='http://10.140.60.25:40006', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-40B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 18:00:50 | INFO | model_worker | Loading the model InternVL2-40B on worker 1c9f40 ...
3
- 2024-07-10 18:00:51 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 18:00:51 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 18:00:54 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 18:00:54 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 18:00:56 | ERROR | stderr |
8
- 2024-07-10 18:00:58 | ERROR | stderr |
9
- 2024-07-10 18:01:00 | ERROR | stderr |
10
- 2024-07-10 18:01:02 | ERROR | stderr |
11
- 2024-07-10 18:01:04 | ERROR | stderr |
12
- 2024-07-10 18:01:06 | ERROR | stderr |
13
- 2024-07-10 18:01:08 | ERROR | stderr |
14
- 2024-07-10 18:01:10 | ERROR | stderr |
15
- 2024-07-10 18:01:12 | ERROR | stderr |
16
- 2024-07-10 18:01:14 | ERROR | stderr |
17
- 2024-07-10 18:01:16 | ERROR | stderr |
18
- 2024-07-10 18:01:18 | ERROR | stderr |
19
- 2024-07-10 18:01:21 | ERROR | stderr |
20
- 2024-07-10 18:01:23 | ERROR | stderr |
21
- 2024-07-10 18:01:25 | ERROR | stderr |
22
- 2024-07-10 18:01:27 | ERROR | stderr |
23
- 2024-07-10 18:01:29 | ERROR | stderr |
24
- 2024-07-10 18:01:30 | ERROR | stderr |
25
- 2024-07-10 18:01:30 | ERROR | stderr |
26
- 2024-07-10 18:01:30 | ERROR | stderr |
27
- 2024-07-10 18:01:31 | INFO | model_worker | Register to controller
28
- 2024-07-10 18:01:31 | ERROR | stderr | INFO: Started server process [62590]
29
- 2024-07-10 18:01:31 | ERROR | stderr | INFO: Waiting for application startup.
30
- 2024-07-10 18:01:31 | ERROR | stderr | INFO: Application startup complete.
31
- 2024-07-10 18:01:31 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40006 (Press CTRL+C to quit)
32
- 2024-07-10 18:01:33 | INFO | stdout | INFO: 10.140.60.209:48796 - "POST /worker_get_status HTTP/1.1" 200 OK
33
- 2024-07-10 18:01:36 | INFO | stdout | INFO: 10.140.60.209:48812 - "POST /worker_get_status HTTP/1.1" 200 OK
34
- 2024-07-10 18:01:38 | INFO | stdout | INFO: 10.140.60.209:48828 - "POST /worker_get_status HTTP/1.1" 200 OK
35
- 2024-07-10 18:01:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
36
- 2024-07-10 18:01:39 | INFO | stdout | INFO: 10.140.60.209:48836 - "POST /worker_generate_stream HTTP/1.1" 200 OK
37
- 2024-07-10 18:01:39 | INFO | stdout | history: []
38
- 2024-07-10 18:01:39 | INFO | stdout | question: Image-1: <image>
39
- 2024-07-10 18:01:39 | INFO | stdout | Describe this image in detail.
40
- 2024-07-10 18:01:39 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F01A84C9A80>]
41
- 2024-07-10 18:01:39 | INFO | model_worker | dynamic_image_size: True
42
- 2024-07-10 18:01:39 | INFO | model_worker | use_thumbnail: True
43
- 2024-07-10 18:01:39 | INFO | model_worker | Resize images to 448x448
44
- 2024-07-10 18:01:39 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
45
- 2024-07-10 18:01:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
46
- 2024-07-10 18:02:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
47
- 2024-07-10 18:02:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_1d82ce.log DELETED
@@ -1,5 +0,0 @@
1
- 2024-07-10 02:04:02 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 02:04:02 | ERROR | stderr | Traceback (most recent call last):
3
- 2024-07-10 02:04:02 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 371, in <module>
4
- 2024-07-10 02:04:02 | ERROR | stderr | if args.multi_modal:
5
- 2024-07-10 02:04:02 | ERROR | stderr | AttributeError: 'Namespace' object has no attribute 'multi_modal'
 
 
 
 
 
 
logs/model_worker_21fda5.log DELETED
@@ -1,545 +0,0 @@
1
- 2024-07-11 22:15:00 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40003, worker_address='http://10.140.60.25:40003', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-4B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:15:00 | INFO | model_worker | Loading the model InternVL2-4B on worker 21fda5 ...
3
- 2024-07-11 22:15:00 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:15:00 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:15:02 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-11 22:15:02 | ERROR | stderr | warnings.warn(
7
- 2024-07-11 22:15:03 | ERROR | stderr |
8
- 2024-07-11 22:15:05 | ERROR | stderr |
9
- 2024-07-11 22:15:06 | ERROR | stderr |
10
- 2024-07-11 22:15:06 | ERROR | stderr |
11
- 2024-07-11 22:15:06 | ERROR | stderr |
12
- 2024-07-11 22:15:10 | INFO | model_worker | Register to controller
13
- 2024-07-11 22:15:10 | ERROR | stderr | INFO: Started server process [47359]
14
- 2024-07-11 22:15:10 | ERROR | stderr | INFO: Waiting for application startup.
15
- 2024-07-11 22:15:10 | ERROR | stderr | INFO: Application startup complete.
16
- 2024-07-11 22:15:10 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40003 (Press CTRL+C to quit)
17
- 2024-07-11 22:15:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
18
- 2024-07-11 22:15:27 | INFO | stdout | INFO: 10.140.60.209:37814 - "POST /worker_get_status HTTP/1.1" 200 OK
19
- 2024-07-11 22:15:27 | INFO | stdout | INFO: 10.140.60.209:37826 - "POST /worker_get_status HTTP/1.1" 200 OK
20
- 2024-07-11 22:15:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
21
- 2024-07-11 22:15:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
22
- 2024-07-11 22:16:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
23
- 2024-07-11 22:16:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
24
- 2024-07-11 22:16:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
25
- 2024-07-11 22:16:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
26
- 2024-07-11 22:17:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
27
- 2024-07-11 22:17:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
28
- 2024-07-11 22:17:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
29
- 2024-07-11 22:17:49 | INFO | stdout | INFO: 10.140.60.209:38560 - "POST /worker_get_status HTTP/1.1" 200 OK
30
- 2024-07-11 22:17:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
31
- 2024-07-11 22:18:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
32
- 2024-07-11 22:18:10 | INFO | model_worker | Register to controller
33
- 2024-07-11 22:18:17 | INFO | stdout | INFO: 10.140.60.209:38752 - "POST /worker_get_status HTTP/1.1" 200 OK
34
- 2024-07-11 22:18:21 | INFO | stdout | INFO: 10.140.60.209:38878 - "POST /worker_get_status HTTP/1.1" 200 OK
35
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:38898 - "POST /worker_get_status HTTP/1.1" 200 OK
36
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:38918 - "POST /worker_get_status HTTP/1.1" 200 OK
37
- 2024-07-11 22:18:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
38
- 2024-07-11 22:18:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
39
- 2024-07-11 22:18:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
40
- 2024-07-11 22:19:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
41
- 2024-07-11 22:19:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
42
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:39360 - "POST /worker_get_status HTTP/1.1" 200 OK
43
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:39376 - "POST /worker_get_status HTTP/1.1" 200 OK
44
- 2024-07-11 22:19:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
45
- 2024-07-11 22:19:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
46
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:39474 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:39492 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:20:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
49
- 2024-07-11 22:20:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
50
- 2024-07-11 22:20:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
51
- 2024-07-11 22:20:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:21:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
53
- 2024-07-11 22:21:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
54
- 2024-07-11 22:21:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:21:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
56
- 2024-07-11 22:22:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:22:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
58
- 2024-07-11 22:22:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
59
- 2024-07-11 22:22:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
60
- 2024-07-11 22:23:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:23:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
62
- 2024-07-11 22:23:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
63
- 2024-07-11 22:23:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:24:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:24:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
66
- 2024-07-11 22:24:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
67
- 2024-07-11 22:24:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
68
- 2024-07-11 22:25:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:25:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:25:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
71
- 2024-07-11 22:25:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
72
- 2024-07-11 22:26:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
73
- 2024-07-11 22:26:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
74
- 2024-07-11 22:26:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
75
- 2024-07-11 22:26:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
76
- 2024-07-11 22:27:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
77
- 2024-07-11 22:27:13 | INFO | stdout | INFO: 10.140.60.209:42100 - "POST /worker_get_status HTTP/1.1" 200 OK
78
- 2024-07-11 22:27:16 | INFO | stdout | INFO: 10.140.60.209:42204 - "POST /worker_get_status HTTP/1.1" 200 OK
79
- 2024-07-11 22:27:17 | INFO | stdout | INFO: 10.140.60.209:42238 - "POST /worker_get_status HTTP/1.1" 200 OK
80
- 2024-07-11 22:27:18 | INFO | stdout | INFO: 10.140.60.209:42258 - "POST /worker_get_status HTTP/1.1" 200 OK
81
- 2024-07-11 22:27:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
82
- 2024-07-11 22:27:32 | INFO | stdout | INFO: 10.140.60.209:42358 - "POST /worker_get_status HTTP/1.1" 200 OK
83
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:42375 - "POST /worker_get_status HTTP/1.1" 200 OK
84
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:42388 - "POST /worker_get_status HTTP/1.1" 200 OK
85
- 2024-07-11 22:27:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
86
- 2024-07-11 22:27:42 | INFO | stdout | INFO: 10.140.60.209:42410 - "POST /worker_get_status HTTP/1.1" 200 OK
87
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:42424 - "POST /worker_get_status HTTP/1.1" 200 OK
88
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:42438 - "POST /worker_get_status HTTP/1.1" 200 OK
89
- 2024-07-11 22:27:51 | INFO | stdout | INFO: 10.140.60.209:42506 - "POST /worker_get_status HTTP/1.1" 200 OK
90
- 2024-07-11 22:27:53 | INFO | stdout | INFO: 10.140.60.209:42538 - "POST /worker_get_status HTTP/1.1" 200 OK
91
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:42554 - "POST /worker_get_status HTTP/1.1" 200 OK
92
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:42570 - "POST /worker_get_status HTTP/1.1" 200 OK
93
- 2024-07-11 22:27:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
94
- 2024-07-11 22:27:55 | INFO | stdout | INFO: 10.140.60.209:42586 - "POST /worker_generate_stream HTTP/1.1" 200 OK
95
- 2024-07-11 22:27:55 | INFO | model_worker | max_input_tile_list: [12]
96
- 2024-07-11 22:27:55 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
97
- 2024-07-11 22:27:55 | INFO | model_worker | []
98
- 2024-07-11 22:27:55 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fad8c264490>}
99
- 2024-07-11 22:27:55 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
100
- 2024-07-11 22:27:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
101
- 2024-07-11 22:27:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
102
- 2024-07-11 22:28:04 | INFO | stdout | INFO: 10.140.60.209:42592 - "POST /worker_get_status HTTP/1.1" 200 OK
103
- 2024-07-11 22:28:07 | INFO | stdout | INFO: 10.140.60.209:42612 - "POST /worker_get_status HTTP/1.1" 200 OK
104
- 2024-07-11 22:28:10 | INFO | stdout | INFO: 10.140.60.209:42640 - "POST /worker_get_status HTTP/1.1" 200 OK
105
- 2024-07-11 22:28:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
106
- 2024-07-11 22:28:12 | INFO | stdout | INFO: 10.140.60.209:42685 - "POST /worker_get_status HTTP/1.1" 200 OK
107
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:42728 - "POST /worker_get_status HTTP/1.1" 200 OK
108
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:42752 - "POST /worker_get_status HTTP/1.1" 200 OK
109
- 2024-07-11 22:28:22 | INFO | stdout | INFO: 10.140.60.209:42944 - "POST /worker_get_status HTTP/1.1" 200 OK
110
- 2024-07-11 22:28:25 | INFO | stdout | INFO: 10.140.60.209:42964 - "POST /worker_get_status HTTP/1.1" 200 OK
111
- 2024-07-11 22:28:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
112
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:42988 - "POST /worker_get_status HTTP/1.1" 200 OK
113
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:43008 - "POST /worker_get_status HTTP/1.1" 200 OK
114
- 2024-07-11 22:28:36 | INFO | stdout | INFO: 10.140.60.209:43068 - "POST /worker_get_status HTTP/1.1" 200 OK
115
- 2024-07-11 22:28:37 | INFO | stdout | INFO: 10.140.60.209:43093 - "POST /worker_get_status HTTP/1.1" 200 OK
116
- 2024-07-11 22:28:38 | INFO | stdout | INFO: 10.140.60.209:43116 - "POST /worker_get_status HTTP/1.1" 200 OK
117
- 2024-07-11 22:28:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
118
- 2024-07-11 22:28:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
119
- 2024-07-11 22:29:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
120
- 2024-07-11 22:29:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
121
- 2024-07-11 22:29:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
122
- 2024-07-11 22:29:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
123
- 2024-07-11 22:30:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
124
- 2024-07-11 22:30:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
125
- 2024-07-11 22:30:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
126
- 2024-07-11 22:30:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
127
- 2024-07-11 22:31:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
128
- 2024-07-11 22:31:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
129
- 2024-07-11 22:31:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
130
- 2024-07-11 22:31:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
131
- 2024-07-11 22:32:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
132
- 2024-07-11 22:32:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
133
- 2024-07-11 22:32:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
134
- 2024-07-11 22:32:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
135
- 2024-07-11 22:33:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
136
- 2024-07-11 22:33:11 | INFO | stdout | INFO: 10.140.60.209:44668 - "POST /worker_get_status HTTP/1.1" 200 OK
137
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:44722 - "POST /worker_get_status HTTP/1.1" 200 OK
138
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:44744 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-11 22:33:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
140
- 2024-07-11 22:33:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
141
- 2024-07-11 22:33:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
142
- 2024-07-11 22:34:02 | INFO | stdout | INFO: 10.140.60.209:45132 - "POST /worker_get_status HTTP/1.1" 200 OK
143
- 2024-07-11 22:34:04 | INFO | stdout | INFO: 10.140.60.209:45152 - "POST /worker_get_status HTTP/1.1" 200 OK
144
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:45172 - "POST /worker_get_status HTTP/1.1" 200 OK
145
- 2024-07-11 22:34:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
146
- 2024-07-11 22:34:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
147
- 2024-07-11 22:34:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
148
- 2024-07-11 22:34:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
149
- 2024-07-11 22:35:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
150
- 2024-07-11 22:35:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
151
- 2024-07-11 22:35:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
152
- 2024-07-11 22:35:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
153
- 2024-07-11 22:36:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
154
- 2024-07-11 22:36:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
155
- 2024-07-11 22:36:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
156
- 2024-07-11 22:36:43 | INFO | stdout | INFO: 10.140.60.209:46218 - "POST /worker_get_status HTTP/1.1" 200 OK
157
- 2024-07-11 22:36:49 | INFO | stdout | INFO: 10.140.60.209:46236 - "POST /worker_get_status HTTP/1.1" 200 OK
158
- 2024-07-11 22:36:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
159
- 2024-07-11 22:36:56 | INFO | stdout | INFO: 10.140.60.209:46338 - "POST /worker_get_status HTTP/1.1" 200 OK
160
- 2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:46360 - "POST /worker_get_status HTTP/1.1" 200 OK
161
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:46382 - "POST /worker_get_status HTTP/1.1" 200 OK
162
- 2024-07-11 22:37:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
163
- 2024-07-11 22:37:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
164
- 2024-07-11 22:37:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
165
- 2024-07-11 22:37:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
166
- 2024-07-11 22:38:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
167
- 2024-07-11 22:38:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
168
- 2024-07-11 22:38:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
169
- 2024-07-11 22:38:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
170
- 2024-07-11 22:39:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
171
- 2024-07-11 22:39:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
172
- 2024-07-11 22:39:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
173
- 2024-07-11 22:39:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
174
- 2024-07-11 22:40:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
175
- 2024-07-11 22:40:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
176
- 2024-07-11 22:40:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
177
- 2024-07-11 22:40:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
178
- 2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:48246 - "POST /worker_get_status HTTP/1.1" 200 OK
179
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:48266 - "POST /worker_get_status HTTP/1.1" 200 OK
180
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:48286 - "POST /worker_get_status HTTP/1.1" 200 OK
181
- 2024-07-11 22:41:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
182
- 2024-07-11 22:41:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
183
- 2024-07-11 22:41:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
184
- 2024-07-11 22:41:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
185
- 2024-07-11 22:42:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
186
- 2024-07-11 22:42:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
187
- 2024-07-11 22:42:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
188
- 2024-07-11 22:42:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
189
- 2024-07-11 22:43:07 | INFO | stdout | INFO: 10.140.60.209:48944 - "POST /worker_get_status HTTP/1.1" 200 OK
190
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:48964 - "POST /worker_get_status HTTP/1.1" 200 OK
191
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:48984 - "POST /worker_get_status HTTP/1.1" 200 OK
192
- 2024-07-11 22:43:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
193
- 2024-07-11 22:43:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
194
- 2024-07-11 22:43:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
195
- 2024-07-11 22:43:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
196
- 2024-07-11 22:44:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
197
- 2024-07-11 22:44:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
198
- 2024-07-11 22:44:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
199
- 2024-07-11 22:44:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
200
- 2024-07-11 22:45:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
201
- 2024-07-11 22:45:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
202
- 2024-07-11 22:45:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
203
- 2024-07-11 22:45:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
204
- 2024-07-11 22:46:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
205
- 2024-07-11 22:46:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
206
- 2024-07-11 22:46:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
207
- 2024-07-11 22:46:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
208
- 2024-07-11 22:47:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
209
- 2024-07-11 22:47:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
210
- 2024-07-11 22:47:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
211
- 2024-07-11 22:47:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
212
- 2024-07-11 22:48:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
213
- 2024-07-11 22:48:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
214
- 2024-07-11 22:48:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
215
- 2024-07-11 22:48:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
216
- 2024-07-11 22:49:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
217
- 2024-07-11 22:49:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
218
- 2024-07-11 22:49:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
219
- 2024-07-11 22:49:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
220
- 2024-07-11 22:50:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
221
- 2024-07-11 22:50:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
222
- 2024-07-11 22:50:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
223
- 2024-07-11 22:50:54 | INFO | stdout | INFO: 10.140.60.209:51538 - "POST /worker_get_status HTTP/1.1" 200 OK
224
- 2024-07-11 22:50:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
225
- 2024-07-11 22:51:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
226
- 2024-07-11 22:51:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
227
- 2024-07-11 22:51:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
228
- 2024-07-11 22:51:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
229
- 2024-07-11 22:52:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
230
- 2024-07-11 22:52:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
231
- 2024-07-11 22:52:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
232
- 2024-07-11 22:52:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
233
- 2024-07-11 22:53:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
234
- 2024-07-11 22:53:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
235
- 2024-07-11 22:53:28 | INFO | stdout | INFO: 10.140.60.209:52460 - "POST /worker_get_status HTTP/1.1" 200 OK
236
- 2024-07-11 22:53:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
237
- 2024-07-11 22:53:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
238
- 2024-07-11 22:54:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
239
- 2024-07-11 22:54:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
240
- 2024-07-11 22:54:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
241
- 2024-07-11 22:54:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
242
- 2024-07-11 22:55:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
243
- 2024-07-11 22:55:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
244
- 2024-07-11 22:55:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
245
- 2024-07-11 22:55:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
246
- 2024-07-11 22:56:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
247
- 2024-07-11 22:56:22 | INFO | stdout | INFO: 10.140.60.209:53412 - "POST /worker_get_status HTTP/1.1" 200 OK
248
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:53432 - "POST /worker_get_status HTTP/1.1" 200 OK
249
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:53452 - "POST /worker_get_status HTTP/1.1" 200 OK
250
- 2024-07-11 22:56:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
251
- 2024-07-11 22:56:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
252
- 2024-07-11 22:56:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
253
- 2024-07-11 22:57:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
254
- 2024-07-11 22:57:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
255
- 2024-07-11 22:57:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
256
- 2024-07-11 22:57:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
257
- 2024-07-11 22:58:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
258
- 2024-07-11 22:58:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
259
- 2024-07-11 22:58:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
260
- 2024-07-11 22:58:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
261
- 2024-07-11 22:59:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
262
- 2024-07-11 22:59:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
263
- 2024-07-11 22:59:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
264
- 2024-07-11 22:59:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
265
- 2024-07-11 23:00:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
266
- 2024-07-11 23:00:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
267
- 2024-07-11 23:00:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
268
- 2024-07-11 23:00:45 | INFO | stdout | INFO: 10.140.60.209:54880 - "POST /worker_get_status HTTP/1.1" 200 OK
269
- 2024-07-11 23:00:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
270
- 2024-07-11 23:01:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
271
- 2024-07-11 23:01:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
272
- 2024-07-11 23:01:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
273
- 2024-07-11 23:01:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
274
- 2024-07-11 23:02:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
275
- 2024-07-11 23:02:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
276
- 2024-07-11 23:02:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
277
- 2024-07-11 23:02:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
278
- 2024-07-11 23:03:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
279
- 2024-07-11 23:03:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
280
- 2024-07-11 23:03:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
281
- 2024-07-11 23:03:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
282
- 2024-07-11 23:04:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
283
- 2024-07-11 23:04:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
284
- 2024-07-11 23:04:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
285
- 2024-07-11 23:04:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
286
- 2024-07-11 23:05:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
287
- 2024-07-11 23:05:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
288
- 2024-07-11 23:05:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
289
- 2024-07-11 23:05:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
290
- 2024-07-11 23:06:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
291
- 2024-07-11 23:06:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
292
- 2024-07-11 23:06:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
293
- 2024-07-11 23:06:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
294
- 2024-07-11 23:07:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
295
- 2024-07-11 23:07:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
296
- 2024-07-11 23:07:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
297
- 2024-07-11 23:07:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
298
- 2024-07-11 23:08:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
299
- 2024-07-11 23:08:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
300
- 2024-07-11 23:08:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
301
- 2024-07-11 23:08:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
302
- 2024-07-11 23:09:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
303
- 2024-07-11 23:09:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
304
- 2024-07-11 23:09:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
305
- 2024-07-11 23:09:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
306
- 2024-07-11 23:10:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
307
- 2024-07-11 23:10:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
308
- 2024-07-11 23:10:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
309
- 2024-07-11 23:10:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
310
- 2024-07-11 23:11:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
311
- 2024-07-11 23:11:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
312
- 2024-07-11 23:11:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
313
- 2024-07-11 23:11:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
314
- 2024-07-11 23:12:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
315
- 2024-07-11 23:12:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
316
- 2024-07-11 23:12:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
317
- 2024-07-11 23:12:45 | INFO | stdout | INFO: 10.140.60.209:59832 - "POST /worker_get_status HTTP/1.1" 200 OK
318
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:59852 - "POST /worker_get_status HTTP/1.1" 200 OK
319
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:59880 - "POST /worker_get_status HTTP/1.1" 200 OK
320
- 2024-07-11 23:12:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
321
- 2024-07-11 23:13:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
322
- 2024-07-11 23:13:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
323
- 2024-07-11 23:13:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
324
- 2024-07-11 23:13:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
325
- 2024-07-11 23:14:08 | INFO | stdout | INFO: 10.140.60.209:60410 - "POST /worker_get_status HTTP/1.1" 200 OK
326
- 2024-07-11 23:14:13 | INFO | stdout | INFO: 10.140.60.209:60476 - "POST /worker_get_status HTTP/1.1" 200 OK
327
- 2024-07-11 23:14:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
328
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:60556 - "POST /worker_get_status HTTP/1.1" 200 OK
329
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:60582 - "POST /worker_get_status HTTP/1.1" 200 OK
330
- 2024-07-11 23:14:21 | INFO | stdout | INFO: 10.140.60.209:60744 - "POST /worker_get_status HTTP/1.1" 200 OK
331
- 2024-07-11 23:14:23 | INFO | stdout | INFO: 10.140.60.209:60818 - "POST /worker_get_status HTTP/1.1" 200 OK
332
- 2024-07-11 23:14:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
333
- 2024-07-11 23:14:33 | INFO | stdout | INFO: 10.140.60.209:60852 - "POST /worker_get_status HTTP/1.1" 200 OK
334
- 2024-07-11 23:14:37 | INFO | stdout | INFO: 10.140.60.209:60872 - "POST /worker_get_status HTTP/1.1" 200 OK
335
- 2024-07-11 23:14:38 | INFO | stdout | INFO: 10.140.60.209:60892 - "POST /worker_get_status HTTP/1.1" 200 OK
336
- 2024-07-11 23:14:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
337
- 2024-07-11 23:14:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
338
- 2024-07-11 23:15:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
339
- 2024-07-11 23:15:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
340
- 2024-07-11 23:15:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
341
- 2024-07-11 23:15:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
342
- 2024-07-11 23:16:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
343
- 2024-07-11 23:16:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
344
- 2024-07-11 23:16:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
345
- 2024-07-11 23:16:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
346
- 2024-07-11 23:17:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
347
- 2024-07-11 23:17:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
348
- 2024-07-11 23:17:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
349
- 2024-07-11 23:18:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
350
- 2024-07-11 23:18:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
351
- 2024-07-11 23:18:20 | INFO | stdout | INFO: 10.140.60.209:34350 - "POST /worker_get_status HTTP/1.1" 200 OK
352
- 2024-07-11 23:18:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
353
- 2024-07-11 23:18:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
354
- 2024-07-11 23:19:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
355
- 2024-07-11 23:19:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
356
- 2024-07-11 23:19:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
357
- 2024-07-11 23:19:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
358
- 2024-07-11 23:20:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
359
- 2024-07-11 23:20:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
360
- 2024-07-11 23:20:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
361
- 2024-07-11 23:20:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
362
- 2024-07-11 23:21:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
363
- 2024-07-11 23:21:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
364
- 2024-07-11 23:21:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
365
- 2024-07-11 23:21:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
366
- 2024-07-11 23:22:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
367
- 2024-07-11 23:22:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
368
- 2024-07-11 23:22:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
369
- 2024-07-11 23:22:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
370
- 2024-07-11 23:23:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
371
- 2024-07-11 23:23:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
372
- 2024-07-11 23:23:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
373
- 2024-07-11 23:23:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
374
- 2024-07-11 23:24:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
375
- 2024-07-11 23:24:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
376
- 2024-07-11 23:24:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
377
- 2024-07-11 23:24:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
378
- 2024-07-11 23:25:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
379
- 2024-07-11 23:25:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
380
- 2024-07-11 23:25:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
381
- 2024-07-11 23:25:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
382
- 2024-07-11 23:26:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
383
- 2024-07-11 23:26:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
384
- 2024-07-11 23:26:29 | INFO | stdout | INFO: 10.140.60.209:37526 - "POST /worker_get_status HTTP/1.1" 200 OK
385
- 2024-07-11 23:26:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
386
- 2024-07-11 23:26:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
387
- 2024-07-11 23:26:48 | INFO | stdout | INFO: 10.140.60.209:37598 - "POST /worker_get_status HTTP/1.1" 200 OK
388
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:37670 - "POST /worker_get_status HTTP/1.1" 200 OK
389
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:37698 - "POST /worker_get_status HTTP/1.1" 200 OK
390
- 2024-07-11 23:27:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
391
- 2024-07-11 23:27:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
392
- 2024-07-11 23:27:29 | INFO | stdout | INFO: 10.140.60.209:37992 - "POST /worker_get_status HTTP/1.1" 200 OK
393
- 2024-07-11 23:27:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
394
- 2024-07-11 23:27:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
395
- 2024-07-11 23:28:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
396
- 2024-07-11 23:28:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
397
- 2024-07-11 23:28:29 | INFO | stdout | INFO: 10.140.60.209:38470 - "POST /worker_get_status HTTP/1.1" 200 OK
398
- 2024-07-11 23:28:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
399
- 2024-07-11 23:28:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
400
- 2024-07-11 23:29:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
401
- 2024-07-11 23:29:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
402
- 2024-07-11 23:29:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
403
- 2024-07-11 23:29:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
404
- 2024-07-11 23:30:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
405
- 2024-07-11 23:30:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
406
- 2024-07-11 23:30:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
407
- 2024-07-11 23:30:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
408
- 2024-07-11 23:31:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
409
- 2024-07-11 23:31:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
410
- 2024-07-11 23:31:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
411
- 2024-07-11 23:31:35 | INFO | stdout | INFO: 10.140.60.209:39650 - "POST /worker_get_status HTTP/1.1" 200 OK
412
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:39670 - "POST /worker_get_status HTTP/1.1" 200 OK
413
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:39690 - "POST /worker_get_status HTTP/1.1" 200 OK
414
- 2024-07-11 23:31:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
415
- 2024-07-11 23:31:51 | INFO | stdout | INFO: 10.140.60.209:39726 - "POST /worker_get_status HTTP/1.1" 200 OK
416
- 2024-07-11 23:32:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
417
- 2024-07-11 23:32:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
418
- 2024-07-11 23:32:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
419
- 2024-07-11 23:32:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
420
- 2024-07-11 23:33:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
421
- 2024-07-11 23:33:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
422
- 2024-07-11 23:33:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
423
- 2024-07-11 23:33:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
424
- 2024-07-11 23:34:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
425
- 2024-07-11 23:34:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
426
- 2024-07-11 23:34:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
427
- 2024-07-11 23:34:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
428
- 2024-07-11 23:35:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
429
- 2024-07-11 23:35:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
430
- 2024-07-11 23:35:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
431
- 2024-07-11 23:35:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
432
- 2024-07-11 23:36:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
433
- 2024-07-11 23:36:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
434
- 2024-07-11 23:36:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
435
- 2024-07-11 23:36:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
436
- 2024-07-11 23:37:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
437
- 2024-07-11 23:37:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
438
- 2024-07-11 23:37:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
439
- 2024-07-11 23:37:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
440
- 2024-07-11 23:38:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
441
- 2024-07-11 23:38:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
442
- 2024-07-11 23:38:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
443
- 2024-07-11 23:38:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
444
- 2024-07-11 23:39:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
445
- 2024-07-11 23:39:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
446
- 2024-07-11 23:39:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
447
- 2024-07-11 23:39:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
448
- 2024-07-11 23:40:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
449
- 2024-07-11 23:40:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
450
- 2024-07-11 23:40:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
451
- 2024-07-11 23:40:41 | INFO | stdout | INFO: 10.140.60.209:43114 - "POST /worker_get_status HTTP/1.1" 200 OK
452
- 2024-07-11 23:40:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
453
- 2024-07-11 23:41:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
454
- 2024-07-11 23:41:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
455
- 2024-07-11 23:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
456
- 2024-07-11 23:41:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
457
- 2024-07-11 23:42:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
458
- 2024-07-11 23:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
459
- 2024-07-11 23:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
460
- 2024-07-11 23:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
461
- 2024-07-11 23:43:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
462
- 2024-07-11 23:43:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
463
- 2024-07-11 23:43:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
464
- 2024-07-11 23:43:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
465
- 2024-07-11 23:44:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
466
- 2024-07-11 23:44:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
467
- 2024-07-11 23:44:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
468
- 2024-07-11 23:44:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
469
- 2024-07-11 23:45:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
470
- 2024-07-11 23:45:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
471
- 2024-07-11 23:45:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
472
- 2024-07-11 23:45:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
473
- 2024-07-11 23:46:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
474
- 2024-07-11 23:46:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
475
- 2024-07-11 23:46:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
476
- 2024-07-11 23:46:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
477
- 2024-07-11 23:47:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
478
- 2024-07-11 23:47:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
479
- 2024-07-11 23:47:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
480
- 2024-07-11 23:47:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
481
- 2024-07-11 23:48:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
482
- 2024-07-11 23:48:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
483
- 2024-07-11 23:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
484
- 2024-07-11 23:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
485
- 2024-07-11 23:49:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
486
- 2024-07-11 23:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
487
- 2024-07-11 23:49:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
488
- 2024-07-11 23:49:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
489
- 2024-07-11 23:50:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
490
- 2024-07-11 23:50:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
491
- 2024-07-11 23:50:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
492
- 2024-07-11 23:50:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
493
- 2024-07-11 23:51:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
494
- 2024-07-11 23:51:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
495
- 2024-07-11 23:51:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
496
- 2024-07-11 23:51:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
497
- 2024-07-11 23:52:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
498
- 2024-07-11 23:52:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
499
- 2024-07-11 23:52:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
500
- 2024-07-11 23:52:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
501
- 2024-07-11 23:53:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
502
- 2024-07-11 23:53:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
503
- 2024-07-11 23:53:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
504
- 2024-07-11 23:53:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
505
- 2024-07-11 23:54:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
506
- 2024-07-11 23:54:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
507
- 2024-07-11 23:54:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
508
- 2024-07-11 23:54:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
509
- 2024-07-11 23:55:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
510
- 2024-07-11 23:55:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
511
- 2024-07-11 23:55:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
512
- 2024-07-11 23:55:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
513
- 2024-07-11 23:56:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
514
- 2024-07-11 23:56:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
515
- 2024-07-11 23:56:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
516
- 2024-07-11 23:56:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
517
- 2024-07-11 23:57:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
518
- 2024-07-11 23:57:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
519
- 2024-07-11 23:57:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
520
- 2024-07-11 23:57:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
521
- 2024-07-11 23:58:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
522
- 2024-07-11 23:58:09 | INFO | stdout | INFO: 10.140.60.209:50000 - "POST /worker_get_status HTTP/1.1" 200 OK
523
- 2024-07-11 23:58:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
524
- 2024-07-11 23:58:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
525
- 2024-07-11 23:58:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
526
- 2024-07-11 23:59:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
527
- 2024-07-11 23:59:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
528
- 2024-07-11 23:59:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
529
- 2024-07-11 23:59:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
530
- 2024-07-12 00:00:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
531
- 2024-07-12 00:00:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
532
- 2024-07-12 00:00:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
533
- 2024-07-12 00:00:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
534
- 2024-07-12 00:01:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
535
- 2024-07-12 00:01:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
536
- 2024-07-12 00:01:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
537
- 2024-07-12 00:01:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
538
- 2024-07-12 00:02:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
539
- 2024-07-12 00:02:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
540
- 2024-07-12 00:02:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
541
- 2024-07-12 00:02:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
542
- 2024-07-12 00:03:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
543
- 2024-07-12 00:03:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
544
- 2024-07-12 00:03:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
545
- 2024-07-12 00:03:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_2370fb.log DELETED
@@ -1,73 +0,0 @@
1
- 2024-07-11 22:26:52 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.66.196:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-78B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:26:52 | INFO | model_worker | Loading the model InternVL2-78B on worker 2370fb ...
3
- 2024-07-11 22:26:53 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:26:53 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:26:59 | ERROR | stderr |
6
- 2024-07-11 22:27:01 | ERROR | stderr |
7
- 2024-07-11 22:27:03 | ERROR | stderr |
8
- 2024-07-11 22:27:05 | ERROR | stderr |
9
- 2024-07-11 22:27:06 | ERROR | stderr |
10
- 2024-07-11 22:27:08 | ERROR | stderr |
11
- 2024-07-11 22:27:10 | ERROR | stderr |
12
- 2024-07-11 22:27:12 | ERROR | stderr |
13
- 2024-07-11 22:27:14 | ERROR | stderr |
14
- 2024-07-11 22:27:16 | ERROR | stderr |
15
- 2024-07-11 22:27:18 | ERROR | stderr |
16
- 2024-07-11 22:27:20 | ERROR | stderr |
17
- 2024-07-11 22:27:22 | ERROR | stderr |
18
- 2024-07-11 22:27:24 | ERROR | stderr |
19
- 2024-07-11 22:27:26 | ERROR | stderr |
20
- 2024-07-11 22:27:27 | ERROR | stderr |
21
- 2024-07-11 22:27:29 | ERROR | stderr |
22
- 2024-07-11 22:27:31 | ERROR | stderr |
23
- 2024-07-11 22:27:33 | ERROR | stderr |
24
- 2024-07-11 22:27:35 | ERROR | stderr |
25
- 2024-07-11 22:27:38 | ERROR | stderr |
26
- 2024-07-11 22:27:40 | ERROR | stderr |
27
- 2024-07-11 22:27:42 | ERROR | stderr |
28
- 2024-07-11 22:27:44 | ERROR | stderr |
29
- 2024-07-11 22:27:46 | ERROR | stderr |
30
- 2024-07-11 22:27:49 | ERROR | stderr |
31
- 2024-07-11 22:27:51 | ERROR | stderr |
32
- 2024-07-11 22:27:53 | ERROR | stderr |
33
- 2024-07-11 22:27:55 | ERROR | stderr |
34
- 2024-07-11 22:27:57 | ERROR | stderr |
35
- 2024-07-11 22:27:59 | ERROR | stderr |
36
- 2024-07-11 22:28:01 | ERROR | stderr |
37
- 2024-07-11 22:28:03 | ERROR | stderr |
38
- 2024-07-11 22:28:04 | ERROR | stderr |
39
- 2024-07-11 22:28:04 | ERROR | stderr |
40
- 2024-07-11 22:28:04 | ERROR | stderr |
41
- 2024-07-11 22:28:05 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:28:05 | ERROR | stderr | INFO: Started server process [28208]
43
- 2024-07-11 22:28:05 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:28:05 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:28:05 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40007 (Press CTRL+C to quit)
46
- 2024-07-11 22:28:07 | INFO | stdout | INFO: 10.140.60.209:42234 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-11 22:28:10 | INFO | stdout | INFO: 10.140.60.209:42262 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:28:12 | INFO | stdout | INFO: 10.140.60.209:42306 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:42350 - "POST /worker_get_status HTTP/1.1" 200 OK
50
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:42375 - "POST /worker_get_status HTTP/1.1" 200 OK
51
- 2024-07-11 22:28:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:28:22 | INFO | stdout | INFO: 10.140.60.209:42566 - "POST /worker_get_status HTTP/1.1" 200 OK
53
- 2024-07-11 22:28:25 | INFO | stdout | INFO: 10.140.60.209:42586 - "POST /worker_get_status HTTP/1.1" 200 OK
54
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:42610 - "POST /worker_get_status HTTP/1.1" 200 OK
55
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:42630 - "POST /worker_get_status HTTP/1.1" 200 OK
56
- 2024-07-11 22:28:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:28:36 | INFO | stdout | INFO: 10.140.60.209:42690 - "POST /worker_get_status HTTP/1.1" 200 OK
58
- 2024-07-11 22:28:37 | INFO | stdout | INFO: 10.140.60.209:42714 - "POST /worker_get_status HTTP/1.1" 200 OK
59
- 2024-07-11 22:28:38 | INFO | stdout | INFO: 10.140.60.209:42738 - "POST /worker_get_status HTTP/1.1" 200 OK
60
- 2024-07-11 22:28:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:29:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
62
- 2024-07-11 22:29:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
63
- 2024-07-11 22:29:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:29:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:30:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
66
- 2024-07-11 22:30:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
67
- 2024-07-11 22:30:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
68
- 2024-07-11 22:30:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:31:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:31:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
71
- 2024-07-11 22:31:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
72
- 2024-07-11 22:31:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
73
- 2024-07-11 22:32:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_25653c.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_25653c.log.2024-07-10 DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_25e2c6.log DELETED
@@ -1,38 +0,0 @@
1
- 2024-07-10 04:43:50 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 04:43:50 | INFO | model_worker | Loading the model InternVL2-1B on worker 25e2c6 ...
3
- 2024-07-10 04:43:51 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 04:43:51 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 04:43:53 | INFO | model_worker | Register to controller
6
- 2024-07-10 04:43:53 | ERROR | stderr | INFO: Started server process [104266]
7
- 2024-07-10 04:43:53 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 04:43:53 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 04:43:53 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 04:43:56 | INFO | stdout | INFO: 10.140.60.209:56010 - "POST /worker_get_status HTTP/1.1" 200 OK
11
- 2024-07-10 04:43:58 | INFO | stdout | INFO: 10.140.60.209:56016 - "POST /worker_get_status HTTP/1.1" 200 OK
12
- 2024-07-10 04:43:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
13
- 2024-07-10 04:43:59 | INFO | stdout | INFO: 10.140.60.209:56024 - "POST /worker_generate_stream HTTP/1.1" 200 OK
14
- 2024-07-10 04:43:59 | INFO | stdout | history: []
15
- 2024-07-10 04:43:59 | INFO | stdout | question: Image-1: <image>
16
- 2024-07-10 04:43:59 | INFO | stdout | Describe this image in detail.
17
- 2024-07-10 04:43:59 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FF56C154130>]
18
- 2024-07-10 04:43:59 | INFO | model_worker | dynamic_image_size: True
19
- 2024-07-10 04:43:59 | INFO | model_worker | use_thumbnail: True
20
- 2024-07-10 04:43:59 | INFO | model_worker | Resize images to 448x448
21
- 2024-07-10 04:43:59 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
22
- 2024-07-10 04:43:59 | ERROR | stderr | Exception in thread Thread-2 (chat):
23
- 2024-07-10 04:43:59 | ERROR | stderr | Traceback (most recent call last):
24
- 2024-07-10 04:43:59 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
25
- 2024-07-10 04:43:59 | ERROR | stderr | self.run()
26
- 2024-07-10 04:43:59 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 946, in run
27
- 2024-07-10 04:43:59 | ERROR | stderr | self._target(*self._args, **self._kwargs)
28
- 2024-07-10 04:43:59 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-1B/modeling_internvl_chat.py", line 280, in chat
29
- 2024-07-10 04:43:59 | ERROR | stderr | generation_output = self.generate(
30
- 2024-07-10 04:43:59 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
31
- 2024-07-10 04:43:59 | ERROR | stderr | return func(*args, **kwargs)
32
- 2024-07-10 04:43:59 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-1B/modeling_internvl_chat.py", line 330, in generate
33
- 2024-07-10 04:43:59 | ERROR | stderr | outputs = self.language_model.generate(
34
- 2024-07-10 04:43:59 | ERROR | stderr | TypeError: transformers.generation.utils.GenerationMixin.generate() got multiple values for keyword argument 'use_cache'
35
- 2024-07-10 04:44:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
36
- 2024-07-10 04:44:09 | INFO | stdout | Caught Unknown Error
37
- 2024-07-10 04:44:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
38
- 2024-07-10 04:44:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_2fa00c.log DELETED
@@ -1,85 +0,0 @@
1
- 2024-07-10 04:29:23 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 04:29:23 | INFO | model_worker | Loading the model InternVL2-1B on worker 2fa00c ...
3
- 2024-07-10 04:29:23 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 04:29:23 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 04:29:26 | INFO | model_worker | Register to controller
6
- 2024-07-10 04:29:26 | ERROR | stderr | INFO: Started server process [72266]
7
- 2024-07-10 04:29:26 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 04:29:26 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 04:29:26 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 04:29:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
11
- 2024-07-10 04:29:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
12
- 2024-07-10 04:30:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
13
- 2024-07-10 04:30:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
14
- 2024-07-10 04:30:35 | INFO | stdout | INFO: 10.140.60.209:53702 - "POST /worker_get_status HTTP/1.1" 200 OK
15
- 2024-07-10 04:30:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
16
- 2024-07-10 04:30:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
17
- 2024-07-10 04:31:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
18
- 2024-07-10 04:31:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
19
- 2024-07-10 04:31:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
20
- 2024-07-10 04:31:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
21
- 2024-07-10 04:32:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
22
- 2024-07-10 04:32:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
23
- 2024-07-10 04:32:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
24
- 2024-07-10 04:32:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
25
- 2024-07-10 04:33:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
26
- 2024-07-10 04:33:12 | INFO | stdout | INFO: 10.140.60.209:54042 - "POST /worker_get_status HTTP/1.1" 200 OK
27
- 2024-07-10 04:33:15 | INFO | stdout | INFO: 10.140.60.209:54122 - "POST /worker_get_status HTTP/1.1" 200 OK
28
- 2024-07-10 04:33:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
29
- 2024-07-10 04:33:16 | INFO | stdout | INFO: 10.140.60.209:54144 - "POST /worker_generate_stream HTTP/1.1" 200 OK
30
- 2024-07-10 04:33:16 | INFO | stdout | history: []
31
- 2024-07-10 04:33:16 | INFO | stdout | question: Image-1: <image>
32
- 2024-07-10 04:33:16 | INFO | stdout | Describe this image in detail.
33
- 2024-07-10 04:33:16 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FA17808C190>]
34
- 2024-07-10 04:33:16 | INFO | model_worker | dynamic_image_size: True
35
- 2024-07-10 04:33:16 | INFO | model_worker | use_thumbnail: True
36
- 2024-07-10 04:33:16 | INFO | model_worker | Resize images to 448x448
37
- 2024-07-10 04:33:16 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
38
- 2024-07-10 04:33:16 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
39
- 2024-07-10 04:33:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
40
- 2024-07-10 04:33:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
41
- 2024-07-10 04:33:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
42
- 2024-07-10 04:33:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
43
- 2024-07-10 04:34:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
44
- 2024-07-10 04:34:13 | INFO | stdout | INFO: 10.140.60.209:54250 - "POST /worker_get_status HTTP/1.1" 200 OK
45
- 2024-07-10 04:34:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
46
- 2024-07-10 04:34:14 | INFO | stdout | INFO: 10.140.60.209:54270 - "POST /worker_generate_stream HTTP/1.1" 200 OK
47
- 2024-07-10 04:34:14 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image depicts three cheetahs in a natural setting, likely a savannah or grassland environment. The cheetahs are positioned in a semi-circle formation, with the adult and two cubs positioned in the center. \n\nThe adult cheetah is positioned on the right side of the image, standing tall with its head slightly tilted forward. It has a sharp, muscular build and a prominent black muzzle. The cheetah’s fur is a mix of brown and black spots, typical of its species, and its eyes are dark and focused, giving it a determined and alert expression.\n\nThe cubs are positioned on the left side of the image, with their heads slightly bowed. The cub on the left is facing the camera, while the one on the right is turned away from the camera, giving a more side profile view. Both cubs have similar coloration and patterns, with the adult cheetah's fur being darker than the cubs’.\n\nThe background of the image is a softly blurred mix of golden and yellow tones, suggesting a late afternoon or early morning setting. This warm, golden light casts a gentle glow on the cheetahs, highlighting their fur and making them stand out against the background.\n\nThe grassy ground is tall and golden, creating a stark contrast with the warm colors of the cheetahs and the background. The overall composition of the image is serene and majestic, capturing the essence of the cheetah's natural habitat.<|im_end|>"]]
48
- 2024-07-10 04:34:14 | INFO | stdout | question: 翻译成中文
49
- 2024-07-10 04:34:14 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FA1780D20E0>]
50
- 2024-07-10 04:34:14 | INFO | model_worker | dynamic_image_size: True
51
- 2024-07-10 04:34:14 | INFO | model_worker | use_thumbnail: True
52
- 2024-07-10 04:34:14 | INFO | model_worker | Resize images to 448x448
53
- 2024-07-10 04:34:14 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
54
- 2024-07-10 04:34:14 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
55
- 2024-07-10 04:34:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
56
- 2024-07-10 04:34:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
57
- 2024-07-10 04:34:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
58
- 2024-07-10 04:34:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
59
- 2024-07-10 04:35:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
60
- 2024-07-10 04:35:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
61
- 2024-07-10 04:35:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
62
- 2024-07-10 04:35:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
63
- 2024-07-10 04:36:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
64
- 2024-07-10 04:36:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
65
- 2024-07-10 04:36:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
66
- 2024-07-10 04:36:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
67
- 2024-07-10 04:37:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
68
- 2024-07-10 04:37:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
69
- 2024-07-10 04:37:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
70
- 2024-07-10 04:37:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
71
- 2024-07-10 04:38:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
72
- 2024-07-10 04:38:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
73
- 2024-07-10 04:38:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
74
- 2024-07-10 04:38:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
75
- 2024-07-10 04:39:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
76
- 2024-07-10 04:39:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
77
- 2024-07-10 04:39:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
78
- 2024-07-10 04:39:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
79
- 2024-07-10 04:40:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
80
- 2024-07-10 04:40:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
81
- 2024-07-10 04:40:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
82
- 2024-07-10 04:40:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
83
- 2024-07-10 04:41:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
84
- 2024-07-10 04:41:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
85
- 2024-07-10 04:41:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_30a4c1.log DELETED
@@ -1,36 +0,0 @@
1
- 2024-07-10 18:02:50 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40006, worker_address='http://10.140.60.25:40006', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-40B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 18:02:50 | INFO | model_worker | Loading the model InternVL2-40B on worker 30a4c1 ...
3
- 2024-07-10 18:02:50 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 18:02:50 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 18:02:52 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 18:02:52 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 18:02:56 | ERROR | stderr |
8
- 2024-07-10 18:02:58 | ERROR | stderr |
9
- 2024-07-10 18:03:00 | ERROR | stderr |
10
- 2024-07-10 18:03:02 | ERROR | stderr |
11
- 2024-07-10 18:03:04 | ERROR | stderr |
12
- 2024-07-10 18:03:06 | ERROR | stderr |
13
- 2024-07-10 18:03:08 | ERROR | stderr |
14
- 2024-07-10 18:03:10 | ERROR | stderr |
15
- 2024-07-10 18:03:12 | ERROR | stderr |
16
- 2024-07-10 18:03:14 | ERROR | stderr |
17
- 2024-07-10 18:03:16 | ERROR | stderr |
18
- 2024-07-10 18:03:18 | ERROR | stderr |
19
- 2024-07-10 18:03:20 | ERROR | stderr |
20
- 2024-07-10 18:03:22 | ERROR | stderr |
21
- 2024-07-10 18:03:24 | ERROR | stderr |
22
- 2024-07-10 18:03:26 | ERROR | stderr |
23
- 2024-07-10 18:03:28 | ERROR | stderr |
24
- 2024-07-10 18:03:29 | ERROR | stderr |
25
- 2024-07-10 18:03:29 | ERROR | stderr |
26
- 2024-07-10 18:03:29 | ERROR | stderr |
27
- 2024-07-10 18:03:29 | INFO | model_worker | Register to controller
28
- 2024-07-10 18:03:29 | ERROR | stderr | INFO: Started server process [67980]
29
- 2024-07-10 18:03:29 | ERROR | stderr | INFO: Waiting for application startup.
30
- 2024-07-10 18:03:29 | ERROR | stderr | INFO: Application startup complete.
31
- 2024-07-10 18:03:29 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40006 (Press CTRL+C to quit)
32
- 2024-07-10 18:03:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
33
- 2024-07-10 18:03:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
34
- 2024-07-10 18:04:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
35
- 2024-07-10 18:04:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
36
- 2024-07-10 18:04:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_326a51.log DELETED
@@ -1,13 +0,0 @@
1
- 2024-07-10 02:06:10 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://0.0.0.0:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 02:06:10 | INFO | model_worker | Loading the model InternVL2-1B on worker 326a51 ...
3
- 2024-07-10 02:06:10 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 02:06:10 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 02:06:13 | INFO | model_worker | Register to controller
6
- 2024-07-10 02:06:13 | ERROR | stderr | Traceback (most recent call last):
7
- 2024-07-10 02:06:13 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 373, in <module>
8
- 2024-07-10 02:06:13 | ERROR | stderr | worker = ModelWorker(args.controller_address,
9
- 2024-07-10 02:06:13 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 161, in __init__
10
- 2024-07-10 02:06:13 | ERROR | stderr | self.register_to_controller()
11
- 2024-07-10 02:06:13 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 176, in register_to_controller
12
- 2024-07-10 02:06:13 | ERROR | stderr | assert r.status_code == 200
13
- 2024-07-10 02:06:13 | ERROR | stderr | AssertionError
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_35f772.log DELETED
@@ -1,155 +0,0 @@
1
- 2024-07-10 17:34:48 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40003, worker_address='http://10.140.60.25:40003', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-4B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 17:34:48 | INFO | model_worker | Loading the model InternVL2-4B on worker 35f772 ...
3
- 2024-07-10 17:34:48 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 17:34:48 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 17:34:50 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 17:34:50 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 17:34:50 | ERROR | stderr |
8
- 2024-07-10 17:35:04 | ERROR | stderr |
9
- 2024-07-10 17:35:12 | ERROR | stderr |
10
- 2024-07-10 17:35:12 | ERROR | stderr |
11
- 2024-07-10 17:35:12 | ERROR | stderr |
12
- 2024-07-10 17:35:16 | INFO | model_worker | Register to controller
13
- 2024-07-10 17:35:16 | ERROR | stderr | INFO: Started server process [4316]
14
- 2024-07-10 17:35:16 | ERROR | stderr | INFO: Waiting for application startup.
15
- 2024-07-10 17:35:16 | ERROR | stderr | INFO: Application startup complete.
16
- 2024-07-10 17:35:16 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40003 (Press CTRL+C to quit)
17
- 2024-07-10 17:35:19 | INFO | stdout | INFO: 10.140.60.209:38568 - "POST /worker_get_status HTTP/1.1" 200 OK
18
- 2024-07-10 17:35:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
19
- 2024-07-10 17:35:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
20
- 2024-07-10 17:36:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
21
- 2024-07-10 17:36:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
22
- 2024-07-10 17:36:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
23
- 2024-07-10 17:36:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
24
- 2024-07-10 17:37:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
25
- 2024-07-10 17:37:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
26
- 2024-07-10 17:37:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
27
- 2024-07-10 17:37:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
28
- 2024-07-10 17:38:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
29
- 2024-07-10 17:38:15 | INFO | stdout | INFO: 10.140.60.209:39160 - "POST /worker_get_status HTTP/1.1" 200 OK
30
- 2024-07-10 17:38:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
31
- 2024-07-10 17:38:17 | INFO | stdout | INFO: 10.140.60.209:39230 - "POST /worker_get_status HTTP/1.1" 200 OK
32
- 2024-07-10 17:38:26 | INFO | stdout | INFO: 10.140.60.209:39274 - "POST /worker_get_status HTTP/1.1" 200 OK
33
- 2024-07-10 17:38:29 | INFO | stdout | INFO: 10.140.60.209:39290 - "POST /worker_get_status HTTP/1.1" 200 OK
34
- 2024-07-10 17:38:30 | INFO | stdout | INFO: 10.140.60.209:39304 - "POST /worker_get_status HTTP/1.1" 200 OK
35
- 2024-07-10 17:38:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
36
- 2024-07-10 17:38:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
37
- 2024-07-10 17:38:50 | INFO | stdout | INFO: 10.140.60.209:39328 - "POST /worker_get_status HTTP/1.1" 200 OK
38
- 2024-07-10 17:39:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
39
- 2024-07-10 17:39:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
40
- 2024-07-10 17:39:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
41
- 2024-07-10 17:39:42 | INFO | stdout | INFO: 10.140.60.209:39532 - "POST /worker_get_status HTTP/1.1" 200 OK
42
- 2024-07-10 17:39:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
43
- 2024-07-10 17:40:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
44
- 2024-07-10 17:40:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
45
- 2024-07-10 17:40:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
46
- 2024-07-10 17:40:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
47
- 2024-07-10 17:41:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
48
- 2024-07-10 17:41:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
49
- 2024-07-10 17:41:31 | INFO | stdout | INFO: 10.140.60.209:39946 - "POST /worker_get_status HTTP/1.1" 200 OK
50
- 2024-07-10 17:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
51
- 2024-07-10 17:41:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
52
- 2024-07-10 17:42:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
53
- 2024-07-10 17:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
54
- 2024-07-10 17:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
55
- 2024-07-10 17:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
56
- 2024-07-10 17:43:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
57
- 2024-07-10 17:43:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
58
- 2024-07-10 17:43:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
59
- 2024-07-10 17:43:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
60
- 2024-07-10 17:44:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
61
- 2024-07-10 17:44:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
62
- 2024-07-10 17:44:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
63
- 2024-07-10 17:44:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
64
- 2024-07-10 17:45:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
65
- 2024-07-10 17:45:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
66
- 2024-07-10 17:45:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
67
- 2024-07-10 17:45:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
68
- 2024-07-10 17:46:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
69
- 2024-07-10 17:46:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
70
- 2024-07-10 17:46:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
71
- 2024-07-10 17:46:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
72
- 2024-07-10 17:47:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
73
- 2024-07-10 17:47:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
74
- 2024-07-10 17:47:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
75
- 2024-07-10 17:47:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
76
- 2024-07-10 17:48:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
77
- 2024-07-10 17:48:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
78
- 2024-07-10 17:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
79
- 2024-07-10 17:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
80
- 2024-07-10 17:49:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
81
- 2024-07-10 17:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
82
- 2024-07-10 17:49:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
83
- 2024-07-10 17:49:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
84
- 2024-07-10 17:50:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
85
- 2024-07-10 17:50:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
86
- 2024-07-10 17:50:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
87
- 2024-07-10 17:50:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
88
- 2024-07-10 17:51:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
89
- 2024-07-10 17:51:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
90
- 2024-07-10 17:51:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
91
- 2024-07-10 17:51:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
92
- 2024-07-10 17:52:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
93
- 2024-07-10 17:52:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
94
- 2024-07-10 17:52:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
95
- 2024-07-10 17:52:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
96
- 2024-07-10 17:53:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
97
- 2024-07-10 17:53:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
98
- 2024-07-10 17:53:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
99
- 2024-07-10 17:53:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
100
- 2024-07-10 17:54:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
101
- 2024-07-10 17:54:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
102
- 2024-07-10 17:54:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
103
- 2024-07-10 17:54:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
104
- 2024-07-10 17:55:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
105
- 2024-07-10 17:55:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
106
- 2024-07-10 17:55:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
107
- 2024-07-10 17:55:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
108
- 2024-07-10 17:56:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
109
- 2024-07-10 17:56:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
110
- 2024-07-10 17:56:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
111
- 2024-07-10 17:56:33 | INFO | stdout | INFO: 10.140.60.209:43642 - "POST /worker_get_status HTTP/1.1" 200 OK
112
- 2024-07-10 17:56:36 | INFO | stdout | INFO: 10.140.60.209:43665 - "POST /worker_get_status HTTP/1.1" 200 OK
113
- 2024-07-10 17:56:37 | INFO | stdout | INFO: 10.140.60.209:43682 - "POST /worker_get_status HTTP/1.1" 200 OK
114
- 2024-07-10 17:56:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
115
- 2024-07-10 17:57:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
116
- 2024-07-10 17:57:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
117
- 2024-07-10 17:57:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
118
- 2024-07-10 17:57:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
119
- 2024-07-10 17:58:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
120
- 2024-07-10 17:58:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
121
- 2024-07-10 17:58:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
122
- 2024-07-10 17:58:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
123
- 2024-07-10 17:59:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
124
- 2024-07-10 17:59:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
125
- 2024-07-10 17:59:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
126
- 2024-07-10 17:59:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
127
- 2024-07-10 18:00:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
128
- 2024-07-10 18:00:15 | INFO | stdout | INFO: 10.140.60.209:44476 - "POST /worker_get_status HTTP/1.1" 200 OK
129
- 2024-07-10 18:00:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
130
- 2024-07-10 18:00:18 | INFO | stdout | INFO: 10.140.60.209:44556 - "POST /worker_get_status HTTP/1.1" 200 OK
131
- 2024-07-10 18:00:19 | INFO | stdout | INFO: 10.140.60.209:44574 - "POST /worker_get_status HTTP/1.1" 200 OK
132
- 2024-07-10 18:00:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
133
- 2024-07-10 18:00:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
134
- 2024-07-10 18:01:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
135
- 2024-07-10 18:01:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
136
- 2024-07-10 18:01:30 | INFO | stdout | INFO: 10.140.60.209:44792 - "POST /worker_get_status HTTP/1.1" 200 OK
137
- 2024-07-10 18:01:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
138
- 2024-07-10 18:01:33 | INFO | stdout | INFO: 10.140.60.209:44806 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-10 18:01:36 | INFO | stdout | INFO: 10.140.60.209:44822 - "POST /worker_get_status HTTP/1.1" 200 OK
140
- 2024-07-10 18:01:38 | INFO | stdout | INFO: 10.140.60.209:44839 - "POST /worker_get_status HTTP/1.1" 200 OK
141
- 2024-07-10 18:01:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
142
- 2024-07-10 18:02:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
143
- 2024-07-10 18:02:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
144
- 2024-07-10 18:02:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
145
- 2024-07-10 18:02:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
146
- 2024-07-10 18:03:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
147
- 2024-07-10 18:03:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
148
- 2024-07-10 18:03:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
149
- 2024-07-10 18:03:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
150
- 2024-07-10 18:04:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
151
- 2024-07-10 18:04:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
152
- 2024-07-10 18:04:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
153
- 2024-07-10 18:04:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
154
- 2024-07-10 18:05:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
155
- 2024-07-10 18:05:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_3a45cb.log DELETED
@@ -1,92 +0,0 @@
1
- 2024-07-11 22:16:03 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40008, worker_address='http://10.140.60.182:40008', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-Pro/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:16:03 | INFO | model_worker | Loading the model InternVL2-Pro on worker 3a45cb ...
3
- 2024-07-11 22:16:03 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:16:03 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:16:13 | ERROR | stderr |
6
- 2024-07-11 22:16:16 | ERROR | stderr |
7
- 2024-07-11 22:16:18 | ERROR | stderr |
8
- 2024-07-11 22:16:20 | ERROR | stderr |
9
- 2024-07-11 22:16:23 | ERROR | stderr |
10
- 2024-07-11 22:16:25 | ERROR | stderr |
11
- 2024-07-11 22:16:27 | ERROR | stderr |
12
- 2024-07-11 22:16:29 | ERROR | stderr |
13
- 2024-07-11 22:16:31 | ERROR | stderr |
14
- 2024-07-11 22:16:33 | ERROR | stderr |
15
- 2024-07-11 22:16:36 | ERROR | stderr |
16
- 2024-07-11 22:16:38 | ERROR | stderr |
17
- 2024-07-11 22:16:40 | ERROR | stderr |
18
- 2024-07-11 22:16:42 | ERROR | stderr |
19
- 2024-07-11 22:16:45 | ERROR | stderr |
20
- 2024-07-11 22:16:47 | ERROR | stderr |
21
- 2024-07-11 22:16:49 | ERROR | stderr |
22
- 2024-07-11 22:16:51 | ERROR | stderr |
23
- 2024-07-11 22:16:53 | ERROR | stderr |
24
- 2024-07-11 22:16:55 | ERROR | stderr |
25
- 2024-07-11 22:16:57 | ERROR | stderr |
26
- 2024-07-11 22:16:59 | ERROR | stderr |
27
- 2024-07-11 22:17:01 | ERROR | stderr |
28
- 2024-07-11 22:17:03 | ERROR | stderr |
29
- 2024-07-11 22:17:05 | ERROR | stderr |
30
- 2024-07-11 22:17:07 | ERROR | stderr |
31
- 2024-07-11 22:17:09 | ERROR | stderr |
32
- 2024-07-11 22:17:11 | ERROR | stderr |
33
- 2024-07-11 22:17:13 | ERROR | stderr |
34
- 2024-07-11 22:17:15 | ERROR | stderr |
35
- 2024-07-11 22:17:17 | ERROR | stderr |
36
- 2024-07-11 22:17:19 | ERROR | stderr |
37
- 2024-07-11 22:17:21 | ERROR | stderr |
38
- 2024-07-11 22:17:22 | ERROR | stderr |
39
- 2024-07-11 22:17:22 | ERROR | stderr |
40
- 2024-07-11 22:17:22 | ERROR | stderr |
41
- 2024-07-11 22:17:23 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:17:23 | ERROR | stderr | INFO: Started server process [106820]
43
- 2024-07-11 22:17:23 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:17:23 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:17:23 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40008 (Press CTRL+C to quit)
46
- 2024-07-11 22:17:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
47
- 2024-07-11 22:17:49 | INFO | stdout | INFO: 10.140.60.209:39404 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:17:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
49
- 2024-07-11 22:18:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
50
- 2024-07-11 22:18:08 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f552f1f8700>: Failed to establish a new connection: [Errno 111] Connection refused'))
51
- 2024-07-11 22:18:13 | INFO | model_worker | Register to controller
52
- 2024-07-11 22:18:17 | INFO | stdout | INFO: 10.140.60.209:39596 - "POST /worker_get_status HTTP/1.1" 200 OK
53
- 2024-07-11 22:18:21 | INFO | stdout | INFO: 10.140.60.209:39722 - "POST /worker_get_status HTTP/1.1" 200 OK
54
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:39742 - "POST /worker_get_status HTTP/1.1" 200 OK
55
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:39762 - "POST /worker_get_status HTTP/1.1" 200 OK
56
- 2024-07-11 22:18:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:18:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
58
- 2024-07-11 22:18:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
59
- 2024-07-11 22:19:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
60
- 2024-07-11 22:19:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:40206 - "POST /worker_get_status HTTP/1.1" 200 OK
62
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:40222 - "POST /worker_get_status HTTP/1.1" 200 OK
63
- 2024-07-11 22:19:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:19:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:40318 - "POST /worker_get_status HTTP/1.1" 200 OK
66
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:40336 - "POST /worker_get_status HTTP/1.1" 200 OK
67
- 2024-07-11 22:20:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
68
- 2024-07-11 22:20:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:20:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:20:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
71
- 2024-07-11 22:21:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
72
- 2024-07-11 22:21:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
73
- 2024-07-11 22:21:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
74
- 2024-07-11 22:21:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
75
- 2024-07-11 22:22:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
76
- 2024-07-11 22:22:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
77
- 2024-07-11 22:22:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
78
- 2024-07-11 22:22:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
79
- 2024-07-11 22:23:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
80
- 2024-07-11 22:23:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
81
- 2024-07-11 22:23:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
82
- 2024-07-11 22:23:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
83
- 2024-07-11 22:24:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
84
- 2024-07-11 22:24:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
85
- 2024-07-11 22:24:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
86
- 2024-07-11 22:24:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
87
- 2024-07-11 22:25:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
88
- 2024-07-11 22:25:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
89
- 2024-07-11 22:25:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
90
- 2024-07-11 22:25:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
91
- 2024-07-11 22:26:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
92
- 2024-07-11 22:26:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_3b3ed1.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_3b962c.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_3b962c.log.2024-07-10 DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_4525cb.log DELETED
@@ -1,548 +0,0 @@
1
- 2024-07-11 22:15:00 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40004, worker_address='http://10.140.60.25:40004', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-8B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:15:00 | INFO | model_worker | Loading the model InternVL2-8B on worker 4525cb ...
3
- 2024-07-11 22:15:00 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:15:00 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:15:02 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-11 22:15:02 | ERROR | stderr | warnings.warn(
7
- 2024-07-11 22:15:03 | ERROR | stderr |
8
- 2024-07-11 22:15:05 | ERROR | stderr |
9
- 2024-07-11 22:15:06 | ERROR | stderr |
10
- 2024-07-11 22:15:07 | ERROR | stderr |
11
- 2024-07-11 22:15:08 | ERROR | stderr |
12
- 2024-07-11 22:15:08 | ERROR | stderr |
13
- 2024-07-11 22:15:08 | ERROR | stderr |
14
- 2024-07-11 22:15:15 | INFO | model_worker | Register to controller
15
- 2024-07-11 22:15:15 | ERROR | stderr | INFO: Started server process [47968]
16
- 2024-07-11 22:15:15 | ERROR | stderr | INFO: Waiting for application startup.
17
- 2024-07-11 22:15:15 | ERROR | stderr | INFO: Application startup complete.
18
- 2024-07-11 22:15:15 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40004 (Press CTRL+C to quit)
19
- 2024-07-11 22:15:27 | INFO | stdout | INFO: 10.140.60.209:60654 - "POST /worker_get_status HTTP/1.1" 200 OK
20
- 2024-07-11 22:15:27 | INFO | stdout | INFO: 10.140.60.209:60672 - "POST /worker_get_status HTTP/1.1" 200 OK
21
- 2024-07-11 22:15:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
22
- 2024-07-11 22:15:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
23
- 2024-07-11 22:16:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
24
- 2024-07-11 22:16:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
25
- 2024-07-11 22:16:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
26
- 2024-07-11 22:16:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
27
- 2024-07-11 22:17:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
28
- 2024-07-11 22:17:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
29
- 2024-07-11 22:17:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
30
- 2024-07-11 22:17:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
31
- 2024-07-11 22:17:49 | INFO | stdout | INFO: 10.140.60.209:33178 - "POST /worker_get_status HTTP/1.1" 200 OK
32
- 2024-07-11 22:18:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
33
- 2024-07-11 22:18:00 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f108014d540>: Failed to establish a new connection: [Errno 111] Connection refused'))
34
- 2024-07-11 22:18:05 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f108014f070>: Failed to establish a new connection: [Errno 111] Connection refused'))
35
- 2024-07-11 22:18:10 | INFO | model_worker | Register to controller
36
- 2024-07-11 22:18:17 | INFO | stdout | INFO: 10.140.60.209:33376 - "POST /worker_get_status HTTP/1.1" 200 OK
37
- 2024-07-11 22:18:21 | INFO | stdout | INFO: 10.140.60.209:33502 - "POST /worker_get_status HTTP/1.1" 200 OK
38
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:33522 - "POST /worker_get_status HTTP/1.1" 200 OK
39
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:33542 - "POST /worker_get_status HTTP/1.1" 200 OK
40
- 2024-07-11 22:18:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
41
- 2024-07-11 22:18:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
42
- 2024-07-11 22:18:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
43
- 2024-07-11 22:19:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
44
- 2024-07-11 22:19:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
45
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:33986 - "POST /worker_get_status HTTP/1.1" 200 OK
46
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:34002 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-11 22:19:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
48
- 2024-07-11 22:19:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
49
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:34098 - "POST /worker_get_status HTTP/1.1" 200 OK
50
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:34116 - "POST /worker_get_status HTTP/1.1" 200 OK
51
- 2024-07-11 22:20:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:20:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
53
- 2024-07-11 22:20:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
54
- 2024-07-11 22:20:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:21:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
56
- 2024-07-11 22:21:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:21:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
58
- 2024-07-11 22:21:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
59
- 2024-07-11 22:22:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
60
- 2024-07-11 22:22:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:22:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
62
- 2024-07-11 22:22:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
63
- 2024-07-11 22:23:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:23:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:23:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
66
- 2024-07-11 22:23:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
67
- 2024-07-11 22:24:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
68
- 2024-07-11 22:24:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:24:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:24:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
71
- 2024-07-11 22:25:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
72
- 2024-07-11 22:25:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
73
- 2024-07-11 22:25:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
74
- 2024-07-11 22:25:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
75
- 2024-07-11 22:26:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
76
- 2024-07-11 22:26:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
77
- 2024-07-11 22:26:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
78
- 2024-07-11 22:26:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
79
- 2024-07-11 22:27:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
80
- 2024-07-11 22:27:13 | INFO | stdout | INFO: 10.140.60.209:36724 - "POST /worker_get_status HTTP/1.1" 200 OK
81
- 2024-07-11 22:27:16 | INFO | stdout | INFO: 10.140.60.209:36828 - "POST /worker_get_status HTTP/1.1" 200 OK
82
- 2024-07-11 22:27:17 | INFO | stdout | INFO: 10.140.60.209:36862 - "POST /worker_get_status HTTP/1.1" 200 OK
83
- 2024-07-11 22:27:18 | INFO | stdout | INFO: 10.140.60.209:36882 - "POST /worker_get_status HTTP/1.1" 200 OK
84
- 2024-07-11 22:27:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
85
- 2024-07-11 22:27:32 | INFO | stdout | INFO: 10.140.60.209:36984 - "POST /worker_get_status HTTP/1.1" 200 OK
86
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:36998 - "POST /worker_get_status HTTP/1.1" 200 OK
87
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:37012 - "POST /worker_get_status HTTP/1.1" 200 OK
88
- 2024-07-11 22:27:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
89
- 2024-07-11 22:27:42 | INFO | stdout | INFO: 10.140.60.209:37034 - "POST /worker_get_status HTTP/1.1" 200 OK
90
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:37048 - "POST /worker_get_status HTTP/1.1" 200 OK
91
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:37062 - "POST /worker_get_status HTTP/1.1" 200 OK
92
- 2024-07-11 22:27:51 | INFO | stdout | INFO: 10.140.60.209:37130 - "POST /worker_get_status HTTP/1.1" 200 OK
93
- 2024-07-11 22:27:53 | INFO | stdout | INFO: 10.140.60.209:37162 - "POST /worker_get_status HTTP/1.1" 200 OK
94
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:37178 - "POST /worker_get_status HTTP/1.1" 200 OK
95
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:37194 - "POST /worker_get_status HTTP/1.1" 200 OK
96
- 2024-07-11 22:27:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
97
- 2024-07-11 22:28:04 | INFO | stdout | INFO: 10.140.60.209:37216 - "POST /worker_get_status HTTP/1.1" 200 OK
98
- 2024-07-11 22:28:07 | INFO | stdout | INFO: 10.140.60.209:37236 - "POST /worker_get_status HTTP/1.1" 200 OK
99
- 2024-07-11 22:28:10 | INFO | stdout | INFO: 10.140.60.209:37264 - "POST /worker_get_status HTTP/1.1" 200 OK
100
- 2024-07-11 22:28:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: None. global_counter: 0
101
- 2024-07-11 22:28:12 | INFO | stdout | INFO: 10.140.60.209:37308 - "POST /worker_get_status HTTP/1.1" 200 OK
102
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:37352 - "POST /worker_get_status HTTP/1.1" 200 OK
103
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:37376 - "POST /worker_get_status HTTP/1.1" 200 OK
104
- 2024-07-11 22:28:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
105
- 2024-07-11 22:28:15 | INFO | stdout | INFO: 10.140.60.209:37408 - "POST /worker_generate_stream HTTP/1.1" 200 OK
106
- 2024-07-11 22:28:15 | INFO | model_worker | max_input_tile_list: [12]
107
- 2024-07-11 22:28:15 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
108
- 2024-07-11 22:28:15 | INFO | model_worker | []
109
- 2024-07-11 22:28:15 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7f108352e7a0>}
110
- 2024-07-11 22:28:15 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
111
- 2024-07-11 22:28:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
112
- 2024-07-11 22:28:22 | INFO | stdout | INFO: 10.140.60.209:37568 - "POST /worker_get_status HTTP/1.1" 200 OK
113
- 2024-07-11 22:28:25 | INFO | stdout | INFO: 10.140.60.209:37588 - "POST /worker_get_status HTTP/1.1" 200 OK
114
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:37612 - "POST /worker_get_status HTTP/1.1" 200 OK
115
- 2024-07-11 22:28:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
116
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:37632 - "POST /worker_get_status HTTP/1.1" 200 OK
117
- 2024-07-11 22:28:36 | INFO | stdout | INFO: 10.140.60.209:37692 - "POST /worker_get_status HTTP/1.1" 200 OK
118
- 2024-07-11 22:28:37 | INFO | stdout | INFO: 10.140.60.209:37716 - "POST /worker_get_status HTTP/1.1" 200 OK
119
- 2024-07-11 22:28:38 | INFO | stdout | INFO: 10.140.60.209:37740 - "POST /worker_get_status HTTP/1.1" 200 OK
120
- 2024-07-11 22:28:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
121
- 2024-07-11 22:28:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
122
- 2024-07-11 22:29:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
123
- 2024-07-11 22:29:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
124
- 2024-07-11 22:29:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
125
- 2024-07-11 22:29:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
126
- 2024-07-11 22:30:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
127
- 2024-07-11 22:30:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
128
- 2024-07-11 22:30:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
129
- 2024-07-11 22:30:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
130
- 2024-07-11 22:31:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
131
- 2024-07-11 22:31:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
132
- 2024-07-11 22:31:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
133
- 2024-07-11 22:31:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
134
- 2024-07-11 22:32:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
135
- 2024-07-11 22:32:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
136
- 2024-07-11 22:32:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
137
- 2024-07-11 22:32:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
138
- 2024-07-11 22:33:11 | INFO | stdout | INFO: 10.140.60.209:39292 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-11 22:33:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
140
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:39346 - "POST /worker_get_status HTTP/1.1" 200 OK
141
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:39368 - "POST /worker_get_status HTTP/1.1" 200 OK
142
- 2024-07-11 22:33:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
143
- 2024-07-11 22:33:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
144
- 2024-07-11 22:33:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
145
- 2024-07-11 22:34:02 | INFO | stdout | INFO: 10.140.60.209:39756 - "POST /worker_get_status HTTP/1.1" 200 OK
146
- 2024-07-11 22:34:04 | INFO | stdout | INFO: 10.140.60.209:39776 - "POST /worker_get_status HTTP/1.1" 200 OK
147
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:39796 - "POST /worker_get_status HTTP/1.1" 200 OK
148
- 2024-07-11 22:34:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
149
- 2024-07-11 22:34:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
150
- 2024-07-11 22:34:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
151
- 2024-07-11 22:34:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
152
- 2024-07-11 22:35:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
153
- 2024-07-11 22:35:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
154
- 2024-07-11 22:35:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
155
- 2024-07-11 22:35:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
156
- 2024-07-11 22:36:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
157
- 2024-07-11 22:36:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
158
- 2024-07-11 22:36:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
159
- 2024-07-11 22:36:43 | INFO | stdout | INFO: 10.140.60.209:40842 - "POST /worker_get_status HTTP/1.1" 200 OK
160
- 2024-07-11 22:36:49 | INFO | stdout | INFO: 10.140.60.209:40860 - "POST /worker_get_status HTTP/1.1" 200 OK
161
- 2024-07-11 22:36:56 | INFO | stdout | INFO: 10.140.60.209:40962 - "POST /worker_get_status HTTP/1.1" 200 OK
162
- 2024-07-11 22:36:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
163
- 2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:40984 - "POST /worker_get_status HTTP/1.1" 200 OK
164
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:41006 - "POST /worker_get_status HTTP/1.1" 200 OK
165
- 2024-07-11 22:37:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
166
- 2024-07-11 22:37:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
167
- 2024-07-11 22:37:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
168
- 2024-07-11 22:37:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
169
- 2024-07-11 22:38:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
170
- 2024-07-11 22:38:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
171
- 2024-07-11 22:38:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
172
- 2024-07-11 22:38:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
173
- 2024-07-11 22:39:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
174
- 2024-07-11 22:39:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
175
- 2024-07-11 22:39:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
176
- 2024-07-11 22:39:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
177
- 2024-07-11 22:40:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
178
- 2024-07-11 22:40:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
179
- 2024-07-11 22:40:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
180
- 2024-07-11 22:40:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
181
- 2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:42870 - "POST /worker_get_status HTTP/1.1" 200 OK
182
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:42890 - "POST /worker_get_status HTTP/1.1" 200 OK
183
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:42910 - "POST /worker_get_status HTTP/1.1" 200 OK
184
- 2024-07-11 22:41:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
185
- 2024-07-11 22:41:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
186
- 2024-07-11 22:41:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
187
- 2024-07-11 22:41:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
188
- 2024-07-11 22:42:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
189
- 2024-07-11 22:42:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
190
- 2024-07-11 22:42:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
191
- 2024-07-11 22:42:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
192
- 2024-07-11 22:43:07 | INFO | stdout | INFO: 10.140.60.209:43568 - "POST /worker_get_status HTTP/1.1" 200 OK
193
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:43588 - "POST /worker_get_status HTTP/1.1" 200 OK
194
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:43608 - "POST /worker_get_status HTTP/1.1" 200 OK
195
- 2024-07-11 22:43:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
196
- 2024-07-11 22:43:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
197
- 2024-07-11 22:43:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
198
- 2024-07-11 22:43:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
199
- 2024-07-11 22:44:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
200
- 2024-07-11 22:44:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
201
- 2024-07-11 22:44:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
202
- 2024-07-11 22:44:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
203
- 2024-07-11 22:45:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
204
- 2024-07-11 22:45:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
205
- 2024-07-11 22:45:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
206
- 2024-07-11 22:45:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
207
- 2024-07-11 22:46:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
208
- 2024-07-11 22:46:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
209
- 2024-07-11 22:46:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
210
- 2024-07-11 22:46:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
211
- 2024-07-11 22:47:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
212
- 2024-07-11 22:47:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
213
- 2024-07-11 22:47:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
214
- 2024-07-11 22:47:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
215
- 2024-07-11 22:48:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
216
- 2024-07-11 22:48:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
217
- 2024-07-11 22:48:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
218
- 2024-07-11 22:48:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
219
- 2024-07-11 22:49:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
220
- 2024-07-11 22:49:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
221
- 2024-07-11 22:49:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
222
- 2024-07-11 22:49:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
223
- 2024-07-11 22:50:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
224
- 2024-07-11 22:50:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
225
- 2024-07-11 22:50:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
226
- 2024-07-11 22:50:54 | INFO | stdout | INFO: 10.140.60.209:46162 - "POST /worker_get_status HTTP/1.1" 200 OK
227
- 2024-07-11 22:50:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
228
- 2024-07-11 22:51:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
229
- 2024-07-11 22:51:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
230
- 2024-07-11 22:51:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
231
- 2024-07-11 22:51:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
232
- 2024-07-11 22:52:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
233
- 2024-07-11 22:52:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
234
- 2024-07-11 22:52:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
235
- 2024-07-11 22:52:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
236
- 2024-07-11 22:53:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
237
- 2024-07-11 22:53:28 | INFO | stdout | INFO: 10.140.60.209:47084 - "POST /worker_get_status HTTP/1.1" 200 OK
238
- 2024-07-11 22:53:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
239
- 2024-07-11 22:53:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
240
- 2024-07-11 22:53:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
241
- 2024-07-11 22:54:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
242
- 2024-07-11 22:54:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
243
- 2024-07-11 22:54:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
244
- 2024-07-11 22:54:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
245
- 2024-07-11 22:55:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
246
- 2024-07-11 22:55:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
247
- 2024-07-11 22:55:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
248
- 2024-07-11 22:55:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
249
- 2024-07-11 22:56:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
250
- 2024-07-11 22:56:22 | INFO | stdout | INFO: 10.140.60.209:48036 - "POST /worker_get_status HTTP/1.1" 200 OK
251
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:48056 - "POST /worker_get_status HTTP/1.1" 200 OK
252
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:48077 - "POST /worker_get_status HTTP/1.1" 200 OK
253
- 2024-07-11 22:56:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
254
- 2024-07-11 22:56:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
255
- 2024-07-11 22:56:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
256
- 2024-07-11 22:57:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
257
- 2024-07-11 22:57:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
258
- 2024-07-11 22:57:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
259
- 2024-07-11 22:57:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
260
- 2024-07-11 22:58:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
261
- 2024-07-11 22:58:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
262
- 2024-07-11 22:58:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
263
- 2024-07-11 22:58:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
264
- 2024-07-11 22:59:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
265
- 2024-07-11 22:59:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
266
- 2024-07-11 22:59:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
267
- 2024-07-11 22:59:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
268
- 2024-07-11 23:00:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
269
- 2024-07-11 23:00:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
270
- 2024-07-11 23:00:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
271
- 2024-07-11 23:00:45 | INFO | stdout | INFO: 10.140.60.209:49504 - "POST /worker_get_status HTTP/1.1" 200 OK
272
- 2024-07-11 23:00:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
273
- 2024-07-11 23:01:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
274
- 2024-07-11 23:01:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
275
- 2024-07-11 23:01:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
276
- 2024-07-11 23:01:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
277
- 2024-07-11 23:02:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
278
- 2024-07-11 23:02:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
279
- 2024-07-11 23:02:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
280
- 2024-07-11 23:02:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
281
- 2024-07-11 23:03:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
282
- 2024-07-11 23:03:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
283
- 2024-07-11 23:03:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
284
- 2024-07-11 23:03:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
285
- 2024-07-11 23:04:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
286
- 2024-07-11 23:04:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
287
- 2024-07-11 23:04:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
288
- 2024-07-11 23:04:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
289
- 2024-07-11 23:05:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
290
- 2024-07-11 23:05:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
291
- 2024-07-11 23:05:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
292
- 2024-07-11 23:05:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
293
- 2024-07-11 23:06:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
294
- 2024-07-11 23:06:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
295
- 2024-07-11 23:06:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
296
- 2024-07-11 23:06:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
297
- 2024-07-11 23:07:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
298
- 2024-07-11 23:07:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
299
- 2024-07-11 23:07:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
300
- 2024-07-11 23:07:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
301
- 2024-07-11 23:08:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
302
- 2024-07-11 23:08:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
303
- 2024-07-11 23:08:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
304
- 2024-07-11 23:08:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
305
- 2024-07-11 23:09:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
306
- 2024-07-11 23:09:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
307
- 2024-07-11 23:09:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
308
- 2024-07-11 23:09:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
309
- 2024-07-11 23:10:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
310
- 2024-07-11 23:10:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
311
- 2024-07-11 23:10:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
312
- 2024-07-11 23:10:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
313
- 2024-07-11 23:11:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
314
- 2024-07-11 23:11:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
315
- 2024-07-11 23:11:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
316
- 2024-07-11 23:11:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
317
- 2024-07-11 23:12:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
318
- 2024-07-11 23:12:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
319
- 2024-07-11 23:12:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
320
- 2024-07-11 23:12:45 | INFO | stdout | INFO: 10.140.60.209:54456 - "POST /worker_get_status HTTP/1.1" 200 OK
321
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:54476 - "POST /worker_get_status HTTP/1.1" 200 OK
322
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:54504 - "POST /worker_get_status HTTP/1.1" 200 OK
323
- 2024-07-11 23:12:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
324
- 2024-07-11 23:13:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
325
- 2024-07-11 23:13:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
326
- 2024-07-11 23:13:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
327
- 2024-07-11 23:13:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
328
- 2024-07-11 23:14:08 | INFO | stdout | INFO: 10.140.60.209:55034 - "POST /worker_get_status HTTP/1.1" 200 OK
329
- 2024-07-11 23:14:13 | INFO | stdout | INFO: 10.140.60.209:55100 - "POST /worker_get_status HTTP/1.1" 200 OK
330
- 2024-07-11 23:14:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
331
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:55180 - "POST /worker_get_status HTTP/1.1" 200 OK
332
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:55206 - "POST /worker_get_status HTTP/1.1" 200 OK
333
- 2024-07-11 23:14:21 | INFO | stdout | INFO: 10.140.60.209:55368 - "POST /worker_get_status HTTP/1.1" 200 OK
334
- 2024-07-11 23:14:23 | INFO | stdout | INFO: 10.140.60.209:55442 - "POST /worker_get_status HTTP/1.1" 200 OK
335
- 2024-07-11 23:14:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
336
- 2024-07-11 23:14:33 | INFO | stdout | INFO: 10.140.60.209:55476 - "POST /worker_get_status HTTP/1.1" 200 OK
337
- 2024-07-11 23:14:37 | INFO | stdout | INFO: 10.140.60.209:55496 - "POST /worker_get_status HTTP/1.1" 200 OK
338
- 2024-07-11 23:14:38 | INFO | stdout | INFO: 10.140.60.209:55516 - "POST /worker_get_status HTTP/1.1" 200 OK
339
- 2024-07-11 23:14:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
340
- 2024-07-11 23:14:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
341
- 2024-07-11 23:15:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
342
- 2024-07-11 23:15:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
343
- 2024-07-11 23:15:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
344
- 2024-07-11 23:16:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
345
- 2024-07-11 23:16:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
346
- 2024-07-11 23:16:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
347
- 2024-07-11 23:16:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
348
- 2024-07-11 23:17:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
349
- 2024-07-11 23:17:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
350
- 2024-07-11 23:17:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
351
- 2024-07-11 23:17:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
352
- 2024-07-11 23:18:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
353
- 2024-07-11 23:18:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
354
- 2024-07-11 23:18:20 | INFO | stdout | INFO: 10.140.60.209:57206 - "POST /worker_get_status HTTP/1.1" 200 OK
355
- 2024-07-11 23:18:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
356
- 2024-07-11 23:18:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
357
- 2024-07-11 23:19:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
358
- 2024-07-11 23:19:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
359
- 2024-07-11 23:19:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
360
- 2024-07-11 23:19:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
361
- 2024-07-11 23:20:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
362
- 2024-07-11 23:20:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
363
- 2024-07-11 23:20:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
364
- 2024-07-11 23:20:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
365
- 2024-07-11 23:21:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
366
- 2024-07-11 23:21:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
367
- 2024-07-11 23:21:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
368
- 2024-07-11 23:21:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
369
- 2024-07-11 23:22:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
370
- 2024-07-11 23:22:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
371
- 2024-07-11 23:22:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
372
- 2024-07-11 23:22:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
373
- 2024-07-11 23:23:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
374
- 2024-07-11 23:23:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
375
- 2024-07-11 23:23:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
376
- 2024-07-11 23:23:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
377
- 2024-07-11 23:24:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
378
- 2024-07-11 23:24:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
379
- 2024-07-11 23:24:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
380
- 2024-07-11 23:24:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
381
- 2024-07-11 23:25:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
382
- 2024-07-11 23:25:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
383
- 2024-07-11 23:25:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
384
- 2024-07-11 23:25:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
385
- 2024-07-11 23:26:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
386
- 2024-07-11 23:26:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
387
- 2024-07-11 23:26:29 | INFO | stdout | INFO: 10.140.60.209:60382 - "POST /worker_get_status HTTP/1.1" 200 OK
388
- 2024-07-11 23:26:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
389
- 2024-07-11 23:26:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
390
- 2024-07-11 23:26:48 | INFO | stdout | INFO: 10.140.60.209:60454 - "POST /worker_get_status HTTP/1.1" 200 OK
391
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:60526 - "POST /worker_get_status HTTP/1.1" 200 OK
392
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:60554 - "POST /worker_get_status HTTP/1.1" 200 OK
393
- 2024-07-11 23:27:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
394
- 2024-07-11 23:27:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
395
- 2024-07-11 23:27:29 | INFO | stdout | INFO: 10.140.60.209:60850 - "POST /worker_get_status HTTP/1.1" 200 OK
396
- 2024-07-11 23:27:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
397
- 2024-07-11 23:27:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
398
- 2024-07-11 23:28:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
399
- 2024-07-11 23:28:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
400
- 2024-07-11 23:28:29 | INFO | stdout | INFO: 10.140.60.209:33094 - "POST /worker_get_status HTTP/1.1" 200 OK
401
- 2024-07-11 23:28:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
402
- 2024-07-11 23:28:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
403
- 2024-07-11 23:29:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
404
- 2024-07-11 23:29:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
405
- 2024-07-11 23:29:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
406
- 2024-07-11 23:29:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
407
- 2024-07-11 23:30:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
408
- 2024-07-11 23:30:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
409
- 2024-07-11 23:30:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
410
- 2024-07-11 23:30:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
411
- 2024-07-11 23:31:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
412
- 2024-07-11 23:31:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
413
- 2024-07-11 23:31:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
414
- 2024-07-11 23:31:35 | INFO | stdout | INFO: 10.140.60.209:34274 - "POST /worker_get_status HTTP/1.1" 200 OK
415
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:34294 - "POST /worker_get_status HTTP/1.1" 200 OK
416
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:34314 - "POST /worker_get_status HTTP/1.1" 200 OK
417
- 2024-07-11 23:31:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
418
- 2024-07-11 23:31:51 | INFO | stdout | INFO: 10.140.60.209:34350 - "POST /worker_get_status HTTP/1.1" 200 OK
419
- 2024-07-11 23:32:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
420
- 2024-07-11 23:32:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
421
- 2024-07-11 23:32:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
422
- 2024-07-11 23:32:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
423
- 2024-07-11 23:33:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
424
- 2024-07-11 23:33:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
425
- 2024-07-11 23:33:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
426
- 2024-07-11 23:33:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
427
- 2024-07-11 23:34:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
428
- 2024-07-11 23:34:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
429
- 2024-07-11 23:34:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
430
- 2024-07-11 23:34:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
431
- 2024-07-11 23:35:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
432
- 2024-07-11 23:35:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
433
- 2024-07-11 23:35:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
434
- 2024-07-11 23:35:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
435
- 2024-07-11 23:36:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
436
- 2024-07-11 23:36:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
437
- 2024-07-11 23:36:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
438
- 2024-07-11 23:36:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
439
- 2024-07-11 23:37:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
440
- 2024-07-11 23:37:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
441
- 2024-07-11 23:37:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
442
- 2024-07-11 23:37:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
443
- 2024-07-11 23:38:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
444
- 2024-07-11 23:38:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
445
- 2024-07-11 23:38:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
446
- 2024-07-11 23:38:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
447
- 2024-07-11 23:39:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
448
- 2024-07-11 23:39:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
449
- 2024-07-11 23:39:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
450
- 2024-07-11 23:39:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
451
- 2024-07-11 23:40:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
452
- 2024-07-11 23:40:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
453
- 2024-07-11 23:40:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
454
- 2024-07-11 23:40:41 | INFO | stdout | INFO: 10.140.60.209:37738 - "POST /worker_get_status HTTP/1.1" 200 OK
455
- 2024-07-11 23:40:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
456
- 2024-07-11 23:41:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
457
- 2024-07-11 23:41:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
458
- 2024-07-11 23:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
459
- 2024-07-11 23:41:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
460
- 2024-07-11 23:42:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
461
- 2024-07-11 23:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
462
- 2024-07-11 23:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
463
- 2024-07-11 23:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
464
- 2024-07-11 23:43:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
465
- 2024-07-11 23:43:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
466
- 2024-07-11 23:43:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
467
- 2024-07-11 23:43:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
468
- 2024-07-11 23:44:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
469
- 2024-07-11 23:44:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
470
- 2024-07-11 23:44:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
471
- 2024-07-11 23:44:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
472
- 2024-07-11 23:45:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
473
- 2024-07-11 23:45:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
474
- 2024-07-11 23:45:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
475
- 2024-07-11 23:45:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
476
- 2024-07-11 23:46:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
477
- 2024-07-11 23:46:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
478
- 2024-07-11 23:46:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
479
- 2024-07-11 23:46:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
480
- 2024-07-11 23:47:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
481
- 2024-07-11 23:47:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
482
- 2024-07-11 23:47:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
483
- 2024-07-11 23:47:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
484
- 2024-07-11 23:48:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
485
- 2024-07-11 23:48:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
486
- 2024-07-11 23:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
487
- 2024-07-11 23:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
488
- 2024-07-11 23:49:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
489
- 2024-07-11 23:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
490
- 2024-07-11 23:49:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
491
- 2024-07-11 23:49:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
492
- 2024-07-11 23:50:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
493
- 2024-07-11 23:50:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
494
- 2024-07-11 23:50:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
495
- 2024-07-11 23:50:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
496
- 2024-07-11 23:51:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
497
- 2024-07-11 23:51:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
498
- 2024-07-11 23:51:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
499
- 2024-07-11 23:51:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
500
- 2024-07-11 23:52:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
501
- 2024-07-11 23:52:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
502
- 2024-07-11 23:52:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
503
- 2024-07-11 23:52:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
504
- 2024-07-11 23:53:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
505
- 2024-07-11 23:53:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
506
- 2024-07-11 23:53:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
507
- 2024-07-11 23:53:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
508
- 2024-07-11 23:54:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
509
- 2024-07-11 23:54:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
510
- 2024-07-11 23:54:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
511
- 2024-07-11 23:54:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
512
- 2024-07-11 23:55:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
513
- 2024-07-11 23:55:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
514
- 2024-07-11 23:55:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
515
- 2024-07-11 23:55:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
516
- 2024-07-11 23:56:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
517
- 2024-07-11 23:56:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
518
- 2024-07-11 23:56:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
519
- 2024-07-11 23:56:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
520
- 2024-07-11 23:57:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
521
- 2024-07-11 23:57:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
522
- 2024-07-11 23:57:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
523
- 2024-07-11 23:57:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
524
- 2024-07-11 23:58:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
525
- 2024-07-11 23:58:09 | INFO | stdout | INFO: 10.140.60.209:44624 - "POST /worker_get_status HTTP/1.1" 200 OK
526
- 2024-07-11 23:58:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
527
- 2024-07-11 23:58:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
528
- 2024-07-11 23:58:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
529
- 2024-07-11 23:59:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
530
- 2024-07-11 23:59:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
531
- 2024-07-11 23:59:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
532
- 2024-07-11 23:59:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
533
- 2024-07-12 00:00:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
534
- 2024-07-12 00:00:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
535
- 2024-07-12 00:00:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
536
- 2024-07-12 00:00:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
537
- 2024-07-12 00:01:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
538
- 2024-07-12 00:01:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
539
- 2024-07-12 00:01:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
540
- 2024-07-12 00:01:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
541
- 2024-07-12 00:02:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
542
- 2024-07-12 00:02:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
543
- 2024-07-12 00:02:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
544
- 2024-07-12 00:02:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
545
- 2024-07-12 00:03:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
546
- 2024-07-12 00:03:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
547
- 2024-07-12 00:03:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
548
- 2024-07-12 00:03:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_4ae09d.log DELETED
@@ -1,88 +0,0 @@
1
- 2024-07-11 22:35:40 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.66.196:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-78B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:35:40 | INFO | model_worker | Loading the model InternVL2-78B on worker 4ae09d ...
3
- 2024-07-11 22:35:40 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:35:40 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:35:44 | ERROR | stderr |
6
- 2024-07-11 22:35:46 | ERROR | stderr |
7
- 2024-07-11 22:35:48 | ERROR | stderr |
8
- 2024-07-11 22:35:50 | ERROR | stderr |
9
- 2024-07-11 22:35:52 | ERROR | stderr |
10
- 2024-07-11 22:35:54 | ERROR | stderr |
11
- 2024-07-11 22:35:56 | ERROR | stderr |
12
- 2024-07-11 22:35:58 | ERROR | stderr |
13
- 2024-07-11 22:36:00 | ERROR | stderr |
14
- 2024-07-11 22:36:02 | ERROR | stderr |
15
- 2024-07-11 22:36:04 | ERROR | stderr |
16
- 2024-07-11 22:36:05 | ERROR | stderr |
17
- 2024-07-11 22:36:07 | ERROR | stderr |
18
- 2024-07-11 22:36:09 | ERROR | stderr |
19
- 2024-07-11 22:36:11 | ERROR | stderr |
20
- 2024-07-11 22:36:13 | ERROR | stderr |
21
- 2024-07-11 22:36:15 | ERROR | stderr |
22
- 2024-07-11 22:36:17 | ERROR | stderr |
23
- 2024-07-11 22:36:19 | ERROR | stderr |
24
- 2024-07-11 22:36:20 | ERROR | stderr |
25
- 2024-07-11 22:36:22 | ERROR | stderr |
26
- 2024-07-11 22:36:24 | ERROR | stderr |
27
- 2024-07-11 22:36:26 | ERROR | stderr |
28
- 2024-07-11 22:36:28 | ERROR | stderr |
29
- 2024-07-11 22:36:30 | ERROR | stderr |
30
- 2024-07-11 22:36:32 | ERROR | stderr |
31
- 2024-07-11 22:36:34 | ERROR | stderr |
32
- 2024-07-11 22:36:36 | ERROR | stderr |
33
- 2024-07-11 22:36:38 | ERROR | stderr |
34
- 2024-07-11 22:36:40 | ERROR | stderr |
35
- 2024-07-11 22:36:43 | ERROR | stderr |
36
- 2024-07-11 22:36:45 | ERROR | stderr |
37
- 2024-07-11 22:36:47 | ERROR | stderr |
38
- 2024-07-11 22:36:48 | ERROR | stderr |
39
- 2024-07-11 22:36:48 | ERROR | stderr |
40
- 2024-07-11 22:36:48 | ERROR | stderr |
41
- 2024-07-11 22:36:49 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:36:49 | ERROR | stderr | INFO: Started server process [50489]
43
- 2024-07-11 22:36:49 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:36:49 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:36:49 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40007 (Press CTRL+C to quit)
46
- 2024-07-11 22:36:57 | INFO | stdout | INFO: 10.140.60.209:45960 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:45984 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:46004 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-11 22:37:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
50
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:46012 - "POST /worker_generate_stream HTTP/1.1" 200 OK
51
- 2024-07-11 22:37:01 | INFO | model_worker | max_input_tile_list: [12]
52
- 2024-07-11 22:37:01 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
53
- 2024-07-11 22:37:01 | INFO | model_worker | []
54
- 2024-07-11 22:37:01 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7f57a8091240>}
55
- 2024-07-11 22:37:03 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
56
- 2024-07-11 22:37:03 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
57
- 2024-07-11 22:37:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
58
- 2024-07-11 22:37:08 | ERROR | stderr | Exception in thread Thread-3 (chat):
59
- 2024-07-11 22:37:08 | ERROR | stderr | Traceback (most recent call last):
60
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
61
- 2024-07-11 22:37:08 | ERROR | stderr | self.run()
62
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 946, in run
63
- 2024-07-11 22:37:08 | ERROR | stderr | self._target(*self._args, **self._kwargs)
64
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 283, in chat
65
- 2024-07-11 22:37:08 | ERROR | stderr | generation_output = self.generate(
66
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
67
- 2024-07-11 22:37:08 | ERROR | stderr | return func(*args, **kwargs)
68
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 333, in generate
69
- 2024-07-11 22:37:08 | ERROR | stderr | outputs = self.language_model.generate(
70
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
71
- 2024-07-11 22:37:08 | ERROR | stderr | return func(*args, **kwargs)
72
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 1525, in generate
73
- 2024-07-11 22:37:08 | ERROR | stderr | return self.sample(
74
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 2641, in sample
75
- 2024-07-11 22:37:08 | ERROR | stderr | next_token_scores = logits_processor(input_ids, next_token_logits)
76
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 97, in __call__
77
- 2024-07-11 22:37:08 | ERROR | stderr | scores = processor(input_ids, scores)
78
- 2024-07-11 22:37:08 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 333, in __call__
79
- 2024-07-11 22:37:08 | ERROR | stderr | score = torch.gather(scores, 1, input_ids)
80
- 2024-07-11 22:37:08 | ERROR | stderr | RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:4 and cuda:0! (when checking argument for argument index in method wrapper_CUDA_gather)
81
- 2024-07-11 22:37:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
82
- 2024-07-11 22:37:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
83
- 2024-07-11 22:37:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
84
- 2024-07-11 22:37:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
85
- 2024-07-11 22:38:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
86
- 2024-07-11 22:38:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
87
- 2024-07-11 22:38:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
88
- 2024-07-11 22:38:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_4e3f4f.log DELETED
@@ -1,539 +0,0 @@
1
- 2024-07-11 22:15:19 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:15:19 | INFO | model_worker | Loading the model InternVL2-1B on worker 4e3f4f ...
3
- 2024-07-11 22:15:19 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:15:19 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:15:21 | INFO | model_worker | Register to controller
6
- 2024-07-11 22:15:21 | ERROR | stderr | INFO: Started server process [50204]
7
- 2024-07-11 22:15:21 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-11 22:15:21 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-11 22:15:21 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-11 22:15:27 | INFO | stdout | INFO: 10.140.60.209:50528 - "POST /worker_get_status HTTP/1.1" 200 OK
11
- 2024-07-11 22:15:27 | INFO | stdout | INFO: 10.140.60.209:50544 - "POST /worker_get_status HTTP/1.1" 200 OK
12
- 2024-07-11 22:15:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
13
- 2024-07-11 22:15:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
14
- 2024-07-11 22:16:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
15
- 2024-07-11 22:16:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
16
- 2024-07-11 22:16:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
17
- 2024-07-11 22:16:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
18
- 2024-07-11 22:17:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
19
- 2024-07-11 22:17:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
20
- 2024-07-11 22:17:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
21
- 2024-07-11 22:17:49 | INFO | stdout | INFO: 10.140.60.209:51284 - "POST /worker_get_status HTTP/1.1" 200 OK
22
- 2024-07-11 22:17:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
23
- 2024-07-11 22:18:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
24
- 2024-07-11 22:18:07 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa1a8495540>: Failed to establish a new connection: [Errno 111] Connection refused'))
25
- 2024-07-11 22:18:12 | INFO | model_worker | Register to controller
26
- 2024-07-11 22:18:17 | INFO | stdout | INFO: 10.140.60.209:51486 - "POST /worker_get_status HTTP/1.1" 200 OK
27
- 2024-07-11 22:18:21 | INFO | stdout | INFO: 10.140.60.209:51612 - "POST /worker_get_status HTTP/1.1" 200 OK
28
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:51632 - "POST /worker_get_status HTTP/1.1" 200 OK
29
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:51652 - "POST /worker_get_status HTTP/1.1" 200 OK
30
- 2024-07-11 22:18:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
31
- 2024-07-11 22:18:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
32
- 2024-07-11 22:18:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
33
- 2024-07-11 22:19:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
34
- 2024-07-11 22:19:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
35
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:52096 - "POST /worker_get_status HTTP/1.1" 200 OK
36
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:52112 - "POST /worker_get_status HTTP/1.1" 200 OK
37
- 2024-07-11 22:19:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
38
- 2024-07-11 22:19:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
39
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:52208 - "POST /worker_get_status HTTP/1.1" 200 OK
40
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:52226 - "POST /worker_get_status HTTP/1.1" 200 OK
41
- 2024-07-11 22:20:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
42
- 2024-07-11 22:20:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
43
- 2024-07-11 22:20:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
44
- 2024-07-11 22:20:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
45
- 2024-07-11 22:21:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
46
- 2024-07-11 22:21:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
47
- 2024-07-11 22:21:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
48
- 2024-07-11 22:21:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
49
- 2024-07-11 22:22:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
50
- 2024-07-11 22:22:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
51
- 2024-07-11 22:22:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:22:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
53
- 2024-07-11 22:23:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
54
- 2024-07-11 22:23:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:23:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
56
- 2024-07-11 22:23:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:24:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
58
- 2024-07-11 22:24:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
59
- 2024-07-11 22:24:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
60
- 2024-07-11 22:24:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:25:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
62
- 2024-07-11 22:25:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
63
- 2024-07-11 22:25:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:25:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:26:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
66
- 2024-07-11 22:26:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
67
- 2024-07-11 22:26:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
68
- 2024-07-11 22:26:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:27:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:27:13 | INFO | stdout | INFO: 10.140.60.209:54834 - "POST /worker_get_status HTTP/1.1" 200 OK
71
- 2024-07-11 22:27:16 | INFO | stdout | INFO: 10.140.60.209:54938 - "POST /worker_get_status HTTP/1.1" 200 OK
72
- 2024-07-11 22:27:17 | INFO | stdout | INFO: 10.140.60.209:54972 - "POST /worker_get_status HTTP/1.1" 200 OK
73
- 2024-07-11 22:27:18 | INFO | stdout | INFO: 10.140.60.209:54992 - "POST /worker_get_status HTTP/1.1" 200 OK
74
- 2024-07-11 22:27:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
75
- 2024-07-11 22:27:18 | INFO | stdout | INFO: 10.140.60.209:55024 - "POST /worker_generate_stream HTTP/1.1" 200 OK
76
- 2024-07-11 22:27:19 | INFO | model_worker | max_input_tile_list: [12]
77
- 2024-07-11 22:27:19 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
78
- 2024-07-11 22:27:19 | INFO | model_worker | []
79
- 2024-07-11 22:27:19 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fa1a82dfcd0>}
80
- 2024-07-11 22:27:19 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
81
- 2024-07-11 22:27:19 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
82
- 2024-07-11 22:27:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
83
- 2024-07-11 22:27:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
84
- 2024-07-11 22:27:32 | INFO | stdout | INFO: 10.140.60.209:55094 - "POST /worker_get_status HTTP/1.1" 200 OK
85
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:55108 - "POST /worker_get_status HTTP/1.1" 200 OK
86
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:55122 - "POST /worker_get_status HTTP/1.1" 200 OK
87
- 2024-07-11 22:27:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
88
- 2024-07-11 22:27:42 | INFO | stdout | INFO: 10.140.60.209:55144 - "POST /worker_get_status HTTP/1.1" 200 OK
89
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:55158 - "POST /worker_get_status HTTP/1.1" 200 OK
90
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:55172 - "POST /worker_get_status HTTP/1.1" 200 OK
91
- 2024-07-11 22:27:51 | INFO | stdout | INFO: 10.140.60.209:55240 - "POST /worker_get_status HTTP/1.1" 200 OK
92
- 2024-07-11 22:27:53 | INFO | stdout | INFO: 10.140.60.209:55272 - "POST /worker_get_status HTTP/1.1" 200 OK
93
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:55288 - "POST /worker_get_status HTTP/1.1" 200 OK
94
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:55304 - "POST /worker_get_status HTTP/1.1" 200 OK
95
- 2024-07-11 22:27:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
96
- 2024-07-11 22:28:04 | INFO | stdout | INFO: 10.140.60.209:55326 - "POST /worker_get_status HTTP/1.1" 200 OK
97
- 2024-07-11 22:28:07 | INFO | stdout | INFO: 10.140.60.209:55346 - "POST /worker_get_status HTTP/1.1" 200 OK
98
- 2024-07-11 22:28:10 | INFO | stdout | INFO: 10.140.60.209:55374 - "POST /worker_get_status HTTP/1.1" 200 OK
99
- 2024-07-11 22:28:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
100
- 2024-07-11 22:28:12 | INFO | stdout | INFO: 10.140.60.209:55418 - "POST /worker_get_status HTTP/1.1" 200 OK
101
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:55462 - "POST /worker_get_status HTTP/1.1" 200 OK
102
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:55486 - "POST /worker_get_status HTTP/1.1" 200 OK
103
- 2024-07-11 22:28:22 | INFO | stdout | INFO: 10.140.60.209:55678 - "POST /worker_get_status HTTP/1.1" 200 OK
104
- 2024-07-11 22:28:25 | INFO | stdout | INFO: 10.140.60.209:55698 - "POST /worker_get_status HTTP/1.1" 200 OK
105
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:55722 - "POST /worker_get_status HTTP/1.1" 200 OK
106
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:55742 - "POST /worker_get_status HTTP/1.1" 200 OK
107
- 2024-07-11 22:28:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
108
- 2024-07-11 22:28:36 | INFO | stdout | INFO: 10.140.60.209:55802 - "POST /worker_get_status HTTP/1.1" 200 OK
109
- 2024-07-11 22:28:37 | INFO | stdout | INFO: 10.140.60.209:55826 - "POST /worker_get_status HTTP/1.1" 200 OK
110
- 2024-07-11 22:28:38 | INFO | stdout | INFO: 10.140.60.209:55850 - "POST /worker_get_status HTTP/1.1" 200 OK
111
- 2024-07-11 22:28:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
112
- 2024-07-11 22:28:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
113
- 2024-07-11 22:29:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
114
- 2024-07-11 22:29:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
115
- 2024-07-11 22:29:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
116
- 2024-07-11 22:29:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
117
- 2024-07-11 22:30:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
118
- 2024-07-11 22:30:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
119
- 2024-07-11 22:30:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
120
- 2024-07-11 22:30:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
121
- 2024-07-11 22:31:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
122
- 2024-07-11 22:31:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
123
- 2024-07-11 22:31:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
124
- 2024-07-11 22:31:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
125
- 2024-07-11 22:32:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
126
- 2024-07-11 22:32:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
127
- 2024-07-11 22:32:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
128
- 2024-07-11 22:32:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
129
- 2024-07-11 22:33:11 | INFO | stdout | INFO: 10.140.60.209:57402 - "POST /worker_get_status HTTP/1.1" 200 OK
130
- 2024-07-11 22:33:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
131
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:57456 - "POST /worker_get_status HTTP/1.1" 200 OK
132
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:57478 - "POST /worker_get_status HTTP/1.1" 200 OK
133
- 2024-07-11 22:33:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
134
- 2024-07-11 22:33:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
135
- 2024-07-11 22:33:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
136
- 2024-07-11 22:34:02 | INFO | stdout | INFO: 10.140.60.209:57866 - "POST /worker_get_status HTTP/1.1" 200 OK
137
- 2024-07-11 22:34:04 | INFO | stdout | INFO: 10.140.60.209:57886 - "POST /worker_get_status HTTP/1.1" 200 OK
138
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:57906 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-11 22:34:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
140
- 2024-07-11 22:34:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
141
- 2024-07-11 22:34:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
142
- 2024-07-11 22:34:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
143
- 2024-07-11 22:35:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
144
- 2024-07-11 22:35:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
145
- 2024-07-11 22:35:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
146
- 2024-07-11 22:35:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
147
- 2024-07-11 22:36:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
148
- 2024-07-11 22:36:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
149
- 2024-07-11 22:36:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
150
- 2024-07-11 22:36:43 | INFO | stdout | INFO: 10.140.60.209:58952 - "POST /worker_get_status HTTP/1.1" 200 OK
151
- 2024-07-11 22:36:49 | INFO | stdout | INFO: 10.140.60.209:58970 - "POST /worker_get_status HTTP/1.1" 200 OK
152
- 2024-07-11 22:36:56 | INFO | stdout | INFO: 10.140.60.209:59072 - "POST /worker_get_status HTTP/1.1" 200 OK
153
- 2024-07-11 22:36:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
154
- 2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:59094 - "POST /worker_get_status HTTP/1.1" 200 OK
155
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:59116 - "POST /worker_get_status HTTP/1.1" 200 OK
156
- 2024-07-11 22:37:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
157
- 2024-07-11 22:37:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
158
- 2024-07-11 22:37:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
159
- 2024-07-11 22:37:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
160
- 2024-07-11 22:38:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
161
- 2024-07-11 22:38:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
162
- 2024-07-11 22:38:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
163
- 2024-07-11 22:38:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
164
- 2024-07-11 22:39:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
165
- 2024-07-11 22:39:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
166
- 2024-07-11 22:39:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
167
- 2024-07-11 22:39:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
168
- 2024-07-11 22:40:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
169
- 2024-07-11 22:40:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
170
- 2024-07-11 22:40:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
171
- 2024-07-11 22:40:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
172
- 2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:60980 - "POST /worker_get_status HTTP/1.1" 200 OK
173
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:32768 - "POST /worker_get_status HTTP/1.1" 200 OK
174
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:32788 - "POST /worker_get_status HTTP/1.1" 200 OK
175
- 2024-07-11 22:41:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
176
- 2024-07-11 22:41:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
177
- 2024-07-11 22:41:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
178
- 2024-07-11 22:41:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
179
- 2024-07-11 22:42:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
180
- 2024-07-11 22:42:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
181
- 2024-07-11 22:42:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
182
- 2024-07-11 22:42:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
183
- 2024-07-11 22:43:07 | INFO | stdout | INFO: 10.140.60.209:33447 - "POST /worker_get_status HTTP/1.1" 200 OK
184
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:33466 - "POST /worker_get_status HTTP/1.1" 200 OK
185
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:33486 - "POST /worker_get_status HTTP/1.1" 200 OK
186
- 2024-07-11 22:43:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
187
- 2024-07-11 22:43:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
188
- 2024-07-11 22:43:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
189
- 2024-07-11 22:43:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
190
- 2024-07-11 22:44:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
191
- 2024-07-11 22:44:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
192
- 2024-07-11 22:44:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
193
- 2024-07-11 22:44:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
194
- 2024-07-11 22:45:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
195
- 2024-07-11 22:45:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
196
- 2024-07-11 22:45:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
197
- 2024-07-11 22:45:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
198
- 2024-07-11 22:46:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
199
- 2024-07-11 22:46:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
200
- 2024-07-11 22:46:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
201
- 2024-07-11 22:46:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
202
- 2024-07-11 22:47:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
203
- 2024-07-11 22:47:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
204
- 2024-07-11 22:47:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
205
- 2024-07-11 22:47:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
206
- 2024-07-11 22:48:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
207
- 2024-07-11 22:48:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
208
- 2024-07-11 22:48:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
209
- 2024-07-11 22:48:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
210
- 2024-07-11 22:49:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
211
- 2024-07-11 22:49:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
212
- 2024-07-11 22:49:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
213
- 2024-07-11 22:49:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
214
- 2024-07-11 22:50:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
215
- 2024-07-11 22:50:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
216
- 2024-07-11 22:50:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
217
- 2024-07-11 22:50:54 | INFO | stdout | INFO: 10.140.60.209:36040 - "POST /worker_get_status HTTP/1.1" 200 OK
218
- 2024-07-11 22:50:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
219
- 2024-07-11 22:51:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
220
- 2024-07-11 22:51:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
221
- 2024-07-11 22:51:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
222
- 2024-07-11 22:51:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
223
- 2024-07-11 22:52:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
224
- 2024-07-11 22:52:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
225
- 2024-07-11 22:52:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
226
- 2024-07-11 22:52:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
227
- 2024-07-11 22:53:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
228
- 2024-07-11 22:53:28 | INFO | stdout | INFO: 10.140.60.209:36963 - "POST /worker_get_status HTTP/1.1" 200 OK
229
- 2024-07-11 22:53:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
230
- 2024-07-11 22:53:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
231
- 2024-07-11 22:53:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
232
- 2024-07-11 22:54:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
233
- 2024-07-11 22:54:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
234
- 2024-07-11 22:54:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
235
- 2024-07-11 22:54:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
236
- 2024-07-11 22:55:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
237
- 2024-07-11 22:55:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
238
- 2024-07-11 22:55:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
239
- 2024-07-11 22:55:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
240
- 2024-07-11 22:56:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
241
- 2024-07-11 22:56:22 | INFO | stdout | INFO: 10.140.60.209:37914 - "POST /worker_get_status HTTP/1.1" 200 OK
242
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:37934 - "POST /worker_get_status HTTP/1.1" 200 OK
243
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:37954 - "POST /worker_get_status HTTP/1.1" 200 OK
244
- 2024-07-11 22:56:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
245
- 2024-07-11 22:56:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
246
- 2024-07-11 22:56:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
247
- 2024-07-11 22:57:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
248
- 2024-07-11 22:57:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
249
- 2024-07-11 22:57:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
250
- 2024-07-11 22:58:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
251
- 2024-07-11 22:58:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
252
- 2024-07-11 22:58:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
253
- 2024-07-11 22:58:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
254
- 2024-07-11 22:59:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
255
- 2024-07-11 22:59:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
256
- 2024-07-11 22:59:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
257
- 2024-07-11 22:59:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
258
- 2024-07-11 23:00:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
259
- 2024-07-11 23:00:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
260
- 2024-07-11 23:00:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
261
- 2024-07-11 23:00:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
262
- 2024-07-11 23:00:45 | INFO | stdout | INFO: 10.140.60.209:39382 - "POST /worker_get_status HTTP/1.1" 200 OK
263
- 2024-07-11 23:01:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
264
- 2024-07-11 23:01:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
265
- 2024-07-11 23:01:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
266
- 2024-07-11 23:01:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
267
- 2024-07-11 23:02:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
268
- 2024-07-11 23:02:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
269
- 2024-07-11 23:02:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
270
- 2024-07-11 23:02:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
271
- 2024-07-11 23:03:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
272
- 2024-07-11 23:03:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
273
- 2024-07-11 23:03:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
274
- 2024-07-11 23:03:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
275
- 2024-07-11 23:04:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
276
- 2024-07-11 23:04:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
277
- 2024-07-11 23:04:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
278
- 2024-07-11 23:04:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
279
- 2024-07-11 23:05:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
280
- 2024-07-11 23:05:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
281
- 2024-07-11 23:05:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
282
- 2024-07-11 23:05:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
283
- 2024-07-11 23:06:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
284
- 2024-07-11 23:06:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
285
- 2024-07-11 23:06:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
286
- 2024-07-11 23:06:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
287
- 2024-07-11 23:07:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
288
- 2024-07-11 23:07:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
289
- 2024-07-11 23:07:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
290
- 2024-07-11 23:07:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
291
- 2024-07-11 23:08:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
292
- 2024-07-11 23:08:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
293
- 2024-07-11 23:08:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
294
- 2024-07-11 23:08:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
295
- 2024-07-11 23:09:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
296
- 2024-07-11 23:09:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
297
- 2024-07-11 23:09:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
298
- 2024-07-11 23:09:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
299
- 2024-07-11 23:10:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
300
- 2024-07-11 23:10:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
301
- 2024-07-11 23:10:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
302
- 2024-07-11 23:10:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
303
- 2024-07-11 23:11:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
304
- 2024-07-11 23:11:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
305
- 2024-07-11 23:11:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
306
- 2024-07-11 23:11:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
307
- 2024-07-11 23:12:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
308
- 2024-07-11 23:12:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
309
- 2024-07-11 23:12:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
310
- 2024-07-11 23:12:45 | INFO | stdout | INFO: 10.140.60.209:44334 - "POST /worker_get_status HTTP/1.1" 200 OK
311
- 2024-07-11 23:12:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
312
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:44354 - "POST /worker_get_status HTTP/1.1" 200 OK
313
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:44382 - "POST /worker_get_status HTTP/1.1" 200 OK
314
- 2024-07-11 23:13:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
315
- 2024-07-11 23:13:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
316
- 2024-07-11 23:13:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
317
- 2024-07-11 23:13:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
318
- 2024-07-11 23:14:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
319
- 2024-07-11 23:14:08 | INFO | stdout | INFO: 10.140.60.209:44912 - "POST /worker_get_status HTTP/1.1" 200 OK
320
- 2024-07-11 23:14:13 | INFO | stdout | INFO: 10.140.60.209:44978 - "POST /worker_get_status HTTP/1.1" 200 OK
321
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:45058 - "POST /worker_get_status HTTP/1.1" 200 OK
322
- 2024-07-11 23:14:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
323
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:45084 - "POST /worker_get_status HTTP/1.1" 200 OK
324
- 2024-07-11 23:14:21 | INFO | stdout | INFO: 10.140.60.209:45246 - "POST /worker_get_status HTTP/1.1" 200 OK
325
- 2024-07-11 23:14:23 | INFO | stdout | INFO: 10.140.60.209:45320 - "POST /worker_get_status HTTP/1.1" 200 OK
326
- 2024-07-11 23:14:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
327
- 2024-07-11 23:14:33 | INFO | stdout | INFO: 10.140.60.209:45354 - "POST /worker_get_status HTTP/1.1" 200 OK
328
- 2024-07-11 23:14:37 | INFO | stdout | INFO: 10.140.60.209:45374 - "POST /worker_get_status HTTP/1.1" 200 OK
329
- 2024-07-11 23:14:38 | INFO | stdout | INFO: 10.140.60.209:45394 - "POST /worker_get_status HTTP/1.1" 200 OK
330
- 2024-07-11 23:14:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
331
- 2024-07-11 23:15:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
332
- 2024-07-11 23:15:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
333
- 2024-07-11 23:15:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
334
- 2024-07-11 23:15:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
335
- 2024-07-11 23:16:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
336
- 2024-07-11 23:16:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
337
- 2024-07-11 23:16:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
338
- 2024-07-11 23:16:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
339
- 2024-07-11 23:17:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
340
- 2024-07-11 23:17:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
341
- 2024-07-11 23:17:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
342
- 2024-07-11 23:17:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
343
- 2024-07-11 23:18:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
344
- 2024-07-11 23:18:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
345
- 2024-07-11 23:18:20 | INFO | stdout | INFO: 10.140.60.209:47084 - "POST /worker_get_status HTTP/1.1" 200 OK
346
- 2024-07-11 23:18:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
347
- 2024-07-11 23:18:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
348
- 2024-07-11 23:19:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
349
- 2024-07-11 23:19:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
350
- 2024-07-11 23:19:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
351
- 2024-07-11 23:19:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
352
- 2024-07-11 23:20:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
353
- 2024-07-11 23:20:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
354
- 2024-07-11 23:20:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
355
- 2024-07-11 23:20:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
356
- 2024-07-11 23:21:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
357
- 2024-07-11 23:21:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
358
- 2024-07-11 23:21:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
359
- 2024-07-11 23:21:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
360
- 2024-07-11 23:22:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
361
- 2024-07-11 23:22:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
362
- 2024-07-11 23:22:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
363
- 2024-07-11 23:22:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
364
- 2024-07-11 23:23:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
365
- 2024-07-11 23:23:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
366
- 2024-07-11 23:23:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
367
- 2024-07-11 23:23:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
368
- 2024-07-11 23:24:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
369
- 2024-07-11 23:24:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
370
- 2024-07-11 23:24:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
371
- 2024-07-11 23:24:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
372
- 2024-07-11 23:25:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
373
- 2024-07-11 23:25:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
374
- 2024-07-11 23:25:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
375
- 2024-07-11 23:25:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
376
- 2024-07-11 23:26:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
377
- 2024-07-11 23:26:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
378
- 2024-07-11 23:26:29 | INFO | stdout | INFO: 10.140.60.209:50260 - "POST /worker_get_status HTTP/1.1" 200 OK
379
- 2024-07-11 23:26:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
380
- 2024-07-11 23:26:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
381
- 2024-07-11 23:26:48 | INFO | stdout | INFO: 10.140.60.209:50332 - "POST /worker_get_status HTTP/1.1" 200 OK
382
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:50404 - "POST /worker_get_status HTTP/1.1" 200 OK
383
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:50432 - "POST /worker_get_status HTTP/1.1" 200 OK
384
- 2024-07-11 23:27:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
385
- 2024-07-11 23:27:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
386
- 2024-07-11 23:27:29 | INFO | stdout | INFO: 10.140.60.209:50728 - "POST /worker_get_status HTTP/1.1" 200 OK
387
- 2024-07-11 23:27:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
388
- 2024-07-11 23:27:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
389
- 2024-07-11 23:28:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
390
- 2024-07-11 23:28:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
391
- 2024-07-11 23:28:29 | INFO | stdout | INFO: 10.140.60.209:51204 - "POST /worker_get_status HTTP/1.1" 200 OK
392
- 2024-07-11 23:28:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
393
- 2024-07-11 23:28:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
394
- 2024-07-11 23:29:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
395
- 2024-07-11 23:29:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
396
- 2024-07-11 23:29:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
397
- 2024-07-11 23:29:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
398
- 2024-07-11 23:30:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
399
- 2024-07-11 23:30:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
400
- 2024-07-11 23:30:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
401
- 2024-07-11 23:30:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
402
- 2024-07-11 23:31:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
403
- 2024-07-11 23:31:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
404
- 2024-07-11 23:31:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
405
- 2024-07-11 23:31:35 | INFO | stdout | INFO: 10.140.60.209:52384 - "POST /worker_get_status HTTP/1.1" 200 OK
406
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:52404 - "POST /worker_get_status HTTP/1.1" 200 OK
407
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:52424 - "POST /worker_get_status HTTP/1.1" 200 OK
408
- 2024-07-11 23:31:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
409
- 2024-07-11 23:31:51 | INFO | stdout | INFO: 10.140.60.209:52460 - "POST /worker_get_status HTTP/1.1" 200 OK
410
- 2024-07-11 23:32:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
411
- 2024-07-11 23:32:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
412
- 2024-07-11 23:32:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
413
- 2024-07-11 23:32:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
414
- 2024-07-11 23:33:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
415
- 2024-07-11 23:33:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
416
- 2024-07-11 23:33:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
417
- 2024-07-11 23:33:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
418
- 2024-07-11 23:34:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
419
- 2024-07-11 23:34:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
420
- 2024-07-11 23:34:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
421
- 2024-07-11 23:34:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
422
- 2024-07-11 23:35:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
423
- 2024-07-11 23:35:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
424
- 2024-07-11 23:35:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
425
- 2024-07-11 23:35:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
426
- 2024-07-11 23:36:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
427
- 2024-07-11 23:36:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
428
- 2024-07-11 23:36:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
429
- 2024-07-11 23:36:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
430
- 2024-07-11 23:37:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
431
- 2024-07-11 23:37:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
432
- 2024-07-11 23:37:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
433
- 2024-07-11 23:37:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
434
- 2024-07-11 23:38:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
435
- 2024-07-11 23:38:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
436
- 2024-07-11 23:38:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
437
- 2024-07-11 23:38:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
438
- 2024-07-11 23:39:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
439
- 2024-07-11 23:39:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
440
- 2024-07-11 23:39:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
441
- 2024-07-11 23:39:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
442
- 2024-07-11 23:40:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
443
- 2024-07-11 23:40:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
444
- 2024-07-11 23:40:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
445
- 2024-07-11 23:40:41 | INFO | stdout | INFO: 10.140.60.209:55848 - "POST /worker_get_status HTTP/1.1" 200 OK
446
- 2024-07-11 23:40:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
447
- 2024-07-11 23:41:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
448
- 2024-07-11 23:41:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
449
- 2024-07-11 23:41:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
450
- 2024-07-11 23:41:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
451
- 2024-07-11 23:42:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
452
- 2024-07-11 23:42:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
453
- 2024-07-11 23:42:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
454
- 2024-07-11 23:42:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
455
- 2024-07-11 23:43:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
456
- 2024-07-11 23:43:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
457
- 2024-07-11 23:43:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
458
- 2024-07-11 23:43:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
459
- 2024-07-11 23:44:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
460
- 2024-07-11 23:44:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
461
- 2024-07-11 23:44:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
462
- 2024-07-11 23:44:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
463
- 2024-07-11 23:45:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
464
- 2024-07-11 23:45:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
465
- 2024-07-11 23:45:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
466
- 2024-07-11 23:45:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
467
- 2024-07-11 23:46:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
468
- 2024-07-11 23:46:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
469
- 2024-07-11 23:46:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
470
- 2024-07-11 23:46:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
471
- 2024-07-11 23:47:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
472
- 2024-07-11 23:47:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
473
- 2024-07-11 23:47:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
474
- 2024-07-11 23:47:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
475
- 2024-07-11 23:48:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
476
- 2024-07-11 23:48:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
477
- 2024-07-11 23:48:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
478
- 2024-07-11 23:48:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
479
- 2024-07-11 23:49:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
480
- 2024-07-11 23:49:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
481
- 2024-07-11 23:49:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
482
- 2024-07-11 23:49:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
483
- 2024-07-11 23:50:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
484
- 2024-07-11 23:50:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
485
- 2024-07-11 23:50:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
486
- 2024-07-11 23:50:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
487
- 2024-07-11 23:51:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
488
- 2024-07-11 23:51:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
489
- 2024-07-11 23:51:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
490
- 2024-07-11 23:51:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
491
- 2024-07-11 23:52:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
492
- 2024-07-11 23:52:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
493
- 2024-07-11 23:52:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
494
- 2024-07-11 23:52:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
495
- 2024-07-11 23:53:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
496
- 2024-07-11 23:53:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
497
- 2024-07-11 23:53:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
498
- 2024-07-11 23:53:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
499
- 2024-07-11 23:54:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
500
- 2024-07-11 23:54:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
501
- 2024-07-11 23:54:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
502
- 2024-07-11 23:54:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
503
- 2024-07-11 23:55:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
504
- 2024-07-11 23:55:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
505
- 2024-07-11 23:55:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
506
- 2024-07-11 23:55:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
507
- 2024-07-11 23:56:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
508
- 2024-07-11 23:56:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
509
- 2024-07-11 23:56:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
510
- 2024-07-11 23:56:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
511
- 2024-07-11 23:57:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
512
- 2024-07-11 23:57:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
513
- 2024-07-11 23:57:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
514
- 2024-07-11 23:57:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
515
- 2024-07-11 23:58:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
516
- 2024-07-11 23:58:09 | INFO | stdout | INFO: 10.140.60.209:34502 - "POST /worker_get_status HTTP/1.1" 200 OK
517
- 2024-07-11 23:58:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
518
- 2024-07-11 23:58:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
519
- 2024-07-11 23:58:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
520
- 2024-07-11 23:59:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
521
- 2024-07-11 23:59:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
522
- 2024-07-11 23:59:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
523
- 2024-07-11 23:59:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
524
- 2024-07-12 00:00:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
525
- 2024-07-12 00:00:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
526
- 2024-07-12 00:00:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
527
- 2024-07-12 00:00:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
528
- 2024-07-12 00:01:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
529
- 2024-07-12 00:01:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
530
- 2024-07-12 00:01:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
531
- 2024-07-12 00:01:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
532
- 2024-07-12 00:02:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
533
- 2024-07-12 00:02:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
534
- 2024-07-12 00:02:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
535
- 2024-07-12 00:02:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
536
- 2024-07-12 00:03:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
537
- 2024-07-12 00:03:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
538
- 2024-07-12 00:03:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
539
- 2024-07-12 00:03:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_4e9294.log DELETED
@@ -1,546 +0,0 @@
1
- 2024-07-11 22:15:24 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40002, worker_address='http://10.140.60.25:40002', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-2B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:15:24 | INFO | model_worker | Loading the model InternVL2-2B on worker 4e9294 ...
3
- 2024-07-11 22:15:25 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:15:25 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:15:30 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-11 22:15:30 | ERROR | stderr | warnings.warn(
7
- 2024-07-11 22:15:32 | INFO | model_worker | Register to controller
8
- 2024-07-11 22:15:32 | ERROR | stderr | INFO: Started server process [50491]
9
- 2024-07-11 22:15:32 | ERROR | stderr | INFO: Waiting for application startup.
10
- 2024-07-11 22:15:32 | ERROR | stderr | INFO: Application startup complete.
11
- 2024-07-11 22:15:32 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40002 (Press CTRL+C to quit)
12
- 2024-07-11 22:15:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
13
- 2024-07-11 22:16:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
14
- 2024-07-11 22:16:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
15
- 2024-07-11 22:16:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
16
- 2024-07-11 22:16:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
17
- 2024-07-11 22:17:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
18
- 2024-07-11 22:17:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
19
- 2024-07-11 22:17:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
20
- 2024-07-11 22:17:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
21
- 2024-07-11 22:17:49 | INFO | stdout | INFO: 10.140.60.209:45806 - "POST /worker_get_status HTTP/1.1" 200 OK
22
- 2024-07-11 22:18:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
23
- 2024-07-11 22:18:02 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fe0305d39d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
24
- 2024-07-11 22:18:07 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fe0306203a0>: Failed to establish a new connection: [Errno 111] Connection refused'))
25
- 2024-07-11 22:18:12 | INFO | model_worker | Register to controller
26
- 2024-07-11 22:18:17 | INFO | stdout | INFO: 10.140.60.209:46002 - "POST /worker_get_status HTTP/1.1" 200 OK
27
- 2024-07-11 22:18:21 | INFO | stdout | INFO: 10.140.60.209:46128 - "POST /worker_get_status HTTP/1.1" 200 OK
28
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:46148 - "POST /worker_get_status HTTP/1.1" 200 OK
29
- 2024-07-11 22:18:22 | INFO | stdout | INFO: 10.140.60.209:46168 - "POST /worker_get_status HTTP/1.1" 200 OK
30
- 2024-07-11 22:18:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
31
- 2024-07-11 22:18:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
32
- 2024-07-11 22:18:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
33
- 2024-07-11 22:19:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
34
- 2024-07-11 22:19:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
35
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:46612 - "POST /worker_get_status HTTP/1.1" 200 OK
36
- 2024-07-11 22:19:32 | INFO | stdout | INFO: 10.140.60.209:46628 - "POST /worker_get_status HTTP/1.1" 200 OK
37
- 2024-07-11 22:19:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
38
- 2024-07-11 22:19:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
39
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:46724 - "POST /worker_get_status HTTP/1.1" 200 OK
40
- 2024-07-11 22:19:59 | INFO | stdout | INFO: 10.140.60.209:46742 - "POST /worker_get_status HTTP/1.1" 200 OK
41
- 2024-07-11 22:20:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
42
- 2024-07-11 22:20:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
43
- 2024-07-11 22:20:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
44
- 2024-07-11 22:20:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
45
- 2024-07-11 22:21:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
46
- 2024-07-11 22:21:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
47
- 2024-07-11 22:21:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
48
- 2024-07-11 22:21:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
49
- 2024-07-11 22:22:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
50
- 2024-07-11 22:22:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
51
- 2024-07-11 22:22:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:22:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
53
- 2024-07-11 22:23:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
54
- 2024-07-11 22:23:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:23:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
56
- 2024-07-11 22:23:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:24:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
58
- 2024-07-11 22:24:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
59
- 2024-07-11 22:24:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
60
- 2024-07-11 22:24:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:25:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
62
- 2024-07-11 22:25:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
63
- 2024-07-11 22:25:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:25:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:26:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
66
- 2024-07-11 22:26:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
67
- 2024-07-11 22:26:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
68
- 2024-07-11 22:26:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:27:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:27:13 | INFO | stdout | INFO: 10.140.60.209:49350 - "POST /worker_get_status HTTP/1.1" 200 OK
71
- 2024-07-11 22:27:16 | INFO | stdout | INFO: 10.140.60.209:49454 - "POST /worker_get_status HTTP/1.1" 200 OK
72
- 2024-07-11 22:27:17 | INFO | stdout | INFO: 10.140.60.209:49488 - "POST /worker_get_status HTTP/1.1" 200 OK
73
- 2024-07-11 22:27:18 | INFO | stdout | INFO: 10.140.60.209:49508 - "POST /worker_get_status HTTP/1.1" 200 OK
74
- 2024-07-11 22:27:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
75
- 2024-07-11 22:27:32 | INFO | stdout | INFO: 10.140.60.209:49610 - "POST /worker_get_status HTTP/1.1" 200 OK
76
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:49624 - "POST /worker_get_status HTTP/1.1" 200 OK
77
- 2024-07-11 22:27:34 | INFO | stdout | INFO: 10.140.60.209:49638 - "POST /worker_get_status HTTP/1.1" 200 OK
78
- 2024-07-11 22:27:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
79
- 2024-07-11 22:27:35 | INFO | stdout | INFO: 10.140.60.209:49644 - "POST /worker_generate_stream HTTP/1.1" 200 OK
80
- 2024-07-11 22:27:35 | INFO | model_worker | max_input_tile_list: [12]
81
- 2024-07-11 22:27:35 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
82
- 2024-07-11 22:27:35 | INFO | model_worker | []
83
- 2024-07-11 22:27:35 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fe03066ba60>}
84
- 2024-07-11 22:27:35 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
85
- 2024-07-11 22:27:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
86
- 2024-07-11 22:27:42 | INFO | stdout | INFO: 10.140.60.209:49660 - "POST /worker_get_status HTTP/1.1" 200 OK
87
- 2024-07-11 22:27:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
88
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:49674 - "POST /worker_get_status HTTP/1.1" 200 OK
89
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:49688 - "POST /worker_get_status HTTP/1.1" 200 OK
90
- 2024-07-11 22:27:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
91
- 2024-07-11 22:27:44 | INFO | stdout | INFO: 10.140.60.209:49694 - "POST /worker_generate_stream HTTP/1.1" 200 OK
92
- 2024-07-11 22:27:44 | INFO | model_worker | max_input_tile_list: [12]
93
- 2024-07-11 22:27:45 | INFO | model_worker | Split images to torch.Size([9, 3, 448, 448])
94
- 2024-07-11 22:27:45 | INFO | model_worker | []
95
- 2024-07-11 22:27:45 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fe01c702140>}
96
- 2024-07-11 22:27:45 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
97
- 2024-07-11 22:27:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
98
- 2024-07-11 22:27:51 | INFO | stdout | INFO: 10.140.60.209:49756 - "POST /worker_get_status HTTP/1.1" 200 OK
99
- 2024-07-11 22:27:53 | INFO | stdout | INFO: 10.140.60.209:49788 - "POST /worker_get_status HTTP/1.1" 200 OK
100
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:49804 - "POST /worker_get_status HTTP/1.1" 200 OK
101
- 2024-07-11 22:27:54 | INFO | stdout | INFO: 10.140.60.209:49820 - "POST /worker_get_status HTTP/1.1" 200 OK
102
- 2024-07-11 22:27:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
103
- 2024-07-11 22:28:04 | INFO | stdout | INFO: 10.140.60.209:49842 - "POST /worker_get_status HTTP/1.1" 200 OK
104
- 2024-07-11 22:28:07 | INFO | stdout | INFO: 10.140.60.209:49862 - "POST /worker_get_status HTTP/1.1" 200 OK
105
- 2024-07-11 22:28:10 | INFO | stdout | INFO: 10.140.60.209:49890 - "POST /worker_get_status HTTP/1.1" 200 OK
106
- 2024-07-11 22:28:12 | INFO | stdout | INFO: 10.140.60.209:49934 - "POST /worker_get_status HTTP/1.1" 200 OK
107
- 2024-07-11 22:28:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
108
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:49978 - "POST /worker_get_status HTTP/1.1" 200 OK
109
- 2024-07-11 22:28:14 | INFO | stdout | INFO: 10.140.60.209:50002 - "POST /worker_get_status HTTP/1.1" 200 OK
110
- 2024-07-11 22:28:22 | INFO | stdout | INFO: 10.140.60.209:50194 - "POST /worker_get_status HTTP/1.1" 200 OK
111
- 2024-07-11 22:28:25 | INFO | stdout | INFO: 10.140.60.209:50214 - "POST /worker_get_status HTTP/1.1" 200 OK
112
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:50238 - "POST /worker_get_status HTTP/1.1" 200 OK
113
- 2024-07-11 22:28:26 | INFO | stdout | INFO: 10.140.60.209:50258 - "POST /worker_get_status HTTP/1.1" 200 OK
114
- 2024-07-11 22:28:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
115
- 2024-07-11 22:28:36 | INFO | stdout | INFO: 10.140.60.209:50318 - "POST /worker_get_status HTTP/1.1" 200 OK
116
- 2024-07-11 22:28:37 | INFO | stdout | INFO: 10.140.60.209:50342 - "POST /worker_get_status HTTP/1.1" 200 OK
117
- 2024-07-11 22:28:38 | INFO | stdout | INFO: 10.140.60.209:50366 - "POST /worker_get_status HTTP/1.1" 200 OK
118
- 2024-07-11 22:28:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
119
- 2024-07-11 22:28:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
120
- 2024-07-11 22:29:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
121
- 2024-07-11 22:29:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
122
- 2024-07-11 22:29:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
123
- 2024-07-11 22:29:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
124
- 2024-07-11 22:30:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
125
- 2024-07-11 22:30:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
126
- 2024-07-11 22:30:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
127
- 2024-07-11 22:30:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
128
- 2024-07-11 22:31:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
129
- 2024-07-11 22:31:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
130
- 2024-07-11 22:31:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
131
- 2024-07-11 22:31:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
132
- 2024-07-11 22:32:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
133
- 2024-07-11 22:32:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
134
- 2024-07-11 22:32:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
135
- 2024-07-11 22:32:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
136
- 2024-07-11 22:33:11 | INFO | stdout | INFO: 10.140.60.209:51918 - "POST /worker_get_status HTTP/1.1" 200 OK
137
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:51972 - "POST /worker_get_status HTTP/1.1" 200 OK
138
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:51994 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-11 22:33:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
140
- 2024-07-11 22:33:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
141
- 2024-07-11 22:33:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
142
- 2024-07-11 22:33:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
143
- 2024-07-11 22:34:02 | INFO | stdout | INFO: 10.140.60.209:52382 - "POST /worker_get_status HTTP/1.1" 200 OK
144
- 2024-07-11 22:34:04 | INFO | stdout | INFO: 10.140.60.209:52402 - "POST /worker_get_status HTTP/1.1" 200 OK
145
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:52422 - "POST /worker_get_status HTTP/1.1" 200 OK
146
- 2024-07-11 22:34:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
147
- 2024-07-11 22:34:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
148
- 2024-07-11 22:34:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
149
- 2024-07-11 22:34:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
150
- 2024-07-11 22:35:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
151
- 2024-07-11 22:35:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
152
- 2024-07-11 22:35:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
153
- 2024-07-11 22:35:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
154
- 2024-07-11 22:36:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
155
- 2024-07-11 22:36:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
156
- 2024-07-11 22:36:43 | INFO | stdout | INFO: 10.140.60.209:53468 - "POST /worker_get_status HTTP/1.1" 200 OK
157
- 2024-07-11 22:36:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
158
- 2024-07-11 22:36:49 | INFO | stdout | INFO: 10.140.60.209:53486 - "POST /worker_get_status HTTP/1.1" 200 OK
159
- 2024-07-11 22:36:56 | INFO | stdout | INFO: 10.140.60.209:53588 - "POST /worker_get_status HTTP/1.1" 200 OK
160
- 2024-07-11 22:36:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
161
- 2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:53610 - "POST /worker_get_status HTTP/1.1" 200 OK
162
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:53632 - "POST /worker_get_status HTTP/1.1" 200 OK
163
- 2024-07-11 22:37:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
164
- 2024-07-11 22:37:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
165
- 2024-07-11 22:37:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
166
- 2024-07-11 22:37:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
167
- 2024-07-11 22:38:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
168
- 2024-07-11 22:38:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
169
- 2024-07-11 22:38:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
170
- 2024-07-11 22:38:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
171
- 2024-07-11 22:39:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
172
- 2024-07-11 22:39:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
173
- 2024-07-11 22:39:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
174
- 2024-07-11 22:39:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
175
- 2024-07-11 22:40:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
176
- 2024-07-11 22:40:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
177
- 2024-07-11 22:40:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
178
- 2024-07-11 22:40:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
179
- 2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:55496 - "POST /worker_get_status HTTP/1.1" 200 OK
180
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:55516 - "POST /worker_get_status HTTP/1.1" 200 OK
181
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:55536 - "POST /worker_get_status HTTP/1.1" 200 OK
182
- 2024-07-11 22:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
183
- 2024-07-11 22:41:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
184
- 2024-07-11 22:41:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
185
- 2024-07-11 22:41:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
186
- 2024-07-11 22:42:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
187
- 2024-07-11 22:42:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
188
- 2024-07-11 22:42:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
189
- 2024-07-11 22:42:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
190
- 2024-07-11 22:43:07 | INFO | stdout | INFO: 10.140.60.209:56194 - "POST /worker_get_status HTTP/1.1" 200 OK
191
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:56214 - "POST /worker_get_status HTTP/1.1" 200 OK
192
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:56234 - "POST /worker_get_status HTTP/1.1" 200 OK
193
- 2024-07-11 22:43:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
194
- 2024-07-11 22:43:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
195
- 2024-07-11 22:43:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
196
- 2024-07-11 22:43:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
197
- 2024-07-11 22:44:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
198
- 2024-07-11 22:44:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
199
- 2024-07-11 22:44:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
200
- 2024-07-11 22:44:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
201
- 2024-07-11 22:45:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
202
- 2024-07-11 22:45:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
203
- 2024-07-11 22:45:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
204
- 2024-07-11 22:45:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
205
- 2024-07-11 22:46:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
206
- 2024-07-11 22:46:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
207
- 2024-07-11 22:46:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
208
- 2024-07-11 22:46:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
209
- 2024-07-11 22:47:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
210
- 2024-07-11 22:47:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
211
- 2024-07-11 22:47:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
212
- 2024-07-11 22:48:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
213
- 2024-07-11 22:48:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
214
- 2024-07-11 22:48:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
215
- 2024-07-11 22:48:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
216
- 2024-07-11 22:49:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
217
- 2024-07-11 22:49:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
218
- 2024-07-11 22:49:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
219
- 2024-07-11 22:49:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
220
- 2024-07-11 22:50:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
221
- 2024-07-11 22:50:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
222
- 2024-07-11 22:50:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
223
- 2024-07-11 22:50:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
224
- 2024-07-11 22:50:54 | INFO | stdout | INFO: 10.140.60.209:58788 - "POST /worker_get_status HTTP/1.1" 200 OK
225
- 2024-07-11 22:51:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
226
- 2024-07-11 22:51:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
227
- 2024-07-11 22:51:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
228
- 2024-07-11 22:51:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
229
- 2024-07-11 22:52:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
230
- 2024-07-11 22:52:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
231
- 2024-07-11 22:52:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
232
- 2024-07-11 22:52:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
233
- 2024-07-11 22:53:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
234
- 2024-07-11 22:53:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
235
- 2024-07-11 22:53:28 | INFO | stdout | INFO: 10.140.60.209:59710 - "POST /worker_get_status HTTP/1.1" 200 OK
236
- 2024-07-11 22:53:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
237
- 2024-07-11 22:53:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
238
- 2024-07-11 22:54:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
239
- 2024-07-11 22:54:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
240
- 2024-07-11 22:54:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
241
- 2024-07-11 22:54:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
242
- 2024-07-11 22:55:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
243
- 2024-07-11 22:55:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
244
- 2024-07-11 22:55:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
245
- 2024-07-11 22:55:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
246
- 2024-07-11 22:56:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
247
- 2024-07-11 22:56:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
248
- 2024-07-11 22:56:22 | INFO | stdout | INFO: 10.140.60.209:60662 - "POST /worker_get_status HTTP/1.1" 200 OK
249
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:60682 - "POST /worker_get_status HTTP/1.1" 200 OK
250
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:60702 - "POST /worker_get_status HTTP/1.1" 200 OK
251
- 2024-07-11 22:56:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
252
- 2024-07-11 22:56:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
253
- 2024-07-11 22:57:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
254
- 2024-07-11 22:57:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
255
- 2024-07-11 22:57:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
256
- 2024-07-11 22:57:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
257
- 2024-07-11 22:58:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
258
- 2024-07-11 22:58:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
259
- 2024-07-11 22:58:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
260
- 2024-07-11 22:58:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
261
- 2024-07-11 22:59:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
262
- 2024-07-11 22:59:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
263
- 2024-07-11 22:59:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
264
- 2024-07-11 22:59:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
265
- 2024-07-11 23:00:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
266
- 2024-07-11 23:00:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
267
- 2024-07-11 23:00:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
268
- 2024-07-11 23:00:45 | INFO | stdout | INFO: 10.140.60.209:33898 - "POST /worker_get_status HTTP/1.1" 200 OK
269
- 2024-07-11 23:00:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
270
- 2024-07-11 23:01:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
271
- 2024-07-11 23:01:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
272
- 2024-07-11 23:01:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
273
- 2024-07-11 23:01:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
274
- 2024-07-11 23:02:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
275
- 2024-07-11 23:02:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
276
- 2024-07-11 23:02:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
277
- 2024-07-11 23:02:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
278
- 2024-07-11 23:03:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
279
- 2024-07-11 23:03:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
280
- 2024-07-11 23:03:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
281
- 2024-07-11 23:03:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
282
- 2024-07-11 23:04:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
283
- 2024-07-11 23:04:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
284
- 2024-07-11 23:04:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
285
- 2024-07-11 23:04:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
286
- 2024-07-11 23:05:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
287
- 2024-07-11 23:05:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
288
- 2024-07-11 23:05:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
289
- 2024-07-11 23:05:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
290
- 2024-07-11 23:06:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
291
- 2024-07-11 23:06:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
292
- 2024-07-11 23:06:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
293
- 2024-07-11 23:06:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
294
- 2024-07-11 23:07:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
295
- 2024-07-11 23:07:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
296
- 2024-07-11 23:07:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
297
- 2024-07-11 23:07:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
298
- 2024-07-11 23:08:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
299
- 2024-07-11 23:08:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
300
- 2024-07-11 23:08:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
301
- 2024-07-11 23:08:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
302
- 2024-07-11 23:09:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
303
- 2024-07-11 23:09:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
304
- 2024-07-11 23:09:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
305
- 2024-07-11 23:09:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
306
- 2024-07-11 23:10:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
307
- 2024-07-11 23:10:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
308
- 2024-07-11 23:10:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
309
- 2024-07-11 23:10:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
310
- 2024-07-11 23:11:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
311
- 2024-07-11 23:11:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
312
- 2024-07-11 23:11:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
313
- 2024-07-11 23:11:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
314
- 2024-07-11 23:12:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
315
- 2024-07-11 23:12:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
316
- 2024-07-11 23:12:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
317
- 2024-07-11 23:12:45 | INFO | stdout | INFO: 10.140.60.209:38850 - "POST /worker_get_status HTTP/1.1" 200 OK
318
- 2024-07-11 23:12:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
319
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:38870 - "POST /worker_get_status HTTP/1.1" 200 OK
320
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:38898 - "POST /worker_get_status HTTP/1.1" 200 OK
321
- 2024-07-11 23:13:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
322
- 2024-07-11 23:13:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
323
- 2024-07-11 23:13:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
324
- 2024-07-11 23:13:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
325
- 2024-07-11 23:14:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
326
- 2024-07-11 23:14:08 | INFO | stdout | INFO: 10.140.60.209:39428 - "POST /worker_get_status HTTP/1.1" 200 OK
327
- 2024-07-11 23:14:13 | INFO | stdout | INFO: 10.140.60.209:39494 - "POST /worker_get_status HTTP/1.1" 200 OK
328
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:39574 - "POST /worker_get_status HTTP/1.1" 200 OK
329
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:39600 - "POST /worker_get_status HTTP/1.1" 200 OK
330
- 2024-07-11 23:14:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
331
- 2024-07-11 23:14:21 | INFO | stdout | INFO: 10.140.60.209:39762 - "POST /worker_get_status HTTP/1.1" 200 OK
332
- 2024-07-11 23:14:23 | INFO | stdout | INFO: 10.140.60.209:39837 - "POST /worker_get_status HTTP/1.1" 200 OK
333
- 2024-07-11 23:14:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
334
- 2024-07-11 23:14:33 | INFO | stdout | INFO: 10.140.60.209:39870 - "POST /worker_get_status HTTP/1.1" 200 OK
335
- 2024-07-11 23:14:37 | INFO | stdout | INFO: 10.140.60.209:39890 - "POST /worker_get_status HTTP/1.1" 200 OK
336
- 2024-07-11 23:14:38 | INFO | stdout | INFO: 10.140.60.209:39910 - "POST /worker_get_status HTTP/1.1" 200 OK
337
- 2024-07-11 23:14:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
338
- 2024-07-11 23:15:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
339
- 2024-07-11 23:15:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
340
- 2024-07-11 23:15:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
341
- 2024-07-11 23:15:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
342
- 2024-07-11 23:16:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
343
- 2024-07-11 23:16:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
344
- 2024-07-11 23:16:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
345
- 2024-07-11 23:16:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
346
- 2024-07-11 23:17:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
347
- 2024-07-11 23:17:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
348
- 2024-07-11 23:17:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
349
- 2024-07-11 23:17:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
350
- 2024-07-11 23:18:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
351
- 2024-07-11 23:18:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
352
- 2024-07-11 23:18:20 | INFO | stdout | INFO: 10.140.60.209:41602 - "POST /worker_get_status HTTP/1.1" 200 OK
353
- 2024-07-11 23:18:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
354
- 2024-07-11 23:18:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
355
- 2024-07-11 23:19:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
356
- 2024-07-11 23:19:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
357
- 2024-07-11 23:19:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
358
- 2024-07-11 23:19:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
359
- 2024-07-11 23:20:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
360
- 2024-07-11 23:20:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
361
- 2024-07-11 23:20:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
362
- 2024-07-11 23:20:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
363
- 2024-07-11 23:21:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
364
- 2024-07-11 23:21:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
365
- 2024-07-11 23:21:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
366
- 2024-07-11 23:21:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
367
- 2024-07-11 23:22:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
368
- 2024-07-11 23:22:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
369
- 2024-07-11 23:22:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
370
- 2024-07-11 23:22:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
371
- 2024-07-11 23:23:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
372
- 2024-07-11 23:23:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
373
- 2024-07-11 23:23:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
374
- 2024-07-11 23:23:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
375
- 2024-07-11 23:24:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
376
- 2024-07-11 23:24:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
377
- 2024-07-11 23:24:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
378
- 2024-07-11 23:24:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
379
- 2024-07-11 23:25:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
380
- 2024-07-11 23:25:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
381
- 2024-07-11 23:25:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
382
- 2024-07-11 23:25:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
383
- 2024-07-11 23:26:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
384
- 2024-07-11 23:26:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
385
- 2024-07-11 23:26:29 | INFO | stdout | INFO: 10.140.60.209:44776 - "POST /worker_get_status HTTP/1.1" 200 OK
386
- 2024-07-11 23:26:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
387
- 2024-07-11 23:26:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
388
- 2024-07-11 23:26:48 | INFO | stdout | INFO: 10.140.60.209:44848 - "POST /worker_get_status HTTP/1.1" 200 OK
389
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:44920 - "POST /worker_get_status HTTP/1.1" 200 OK
390
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:44948 - "POST /worker_get_status HTTP/1.1" 200 OK
391
- 2024-07-11 23:27:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
392
- 2024-07-11 23:27:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
393
- 2024-07-11 23:27:29 | INFO | stdout | INFO: 10.140.60.209:45244 - "POST /worker_get_status HTTP/1.1" 200 OK
394
- 2024-07-11 23:27:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
395
- 2024-07-11 23:27:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
396
- 2024-07-11 23:28:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
397
- 2024-07-11 23:28:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
398
- 2024-07-11 23:28:29 | INFO | stdout | INFO: 10.140.60.209:45720 - "POST /worker_get_status HTTP/1.1" 200 OK
399
- 2024-07-11 23:28:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
400
- 2024-07-11 23:28:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
401
- 2024-07-11 23:29:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
402
- 2024-07-11 23:29:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
403
- 2024-07-11 23:29:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
404
- 2024-07-11 23:29:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
405
- 2024-07-11 23:30:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
406
- 2024-07-11 23:30:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
407
- 2024-07-11 23:30:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
408
- 2024-07-11 23:30:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
409
- 2024-07-11 23:31:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
410
- 2024-07-11 23:31:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
411
- 2024-07-11 23:31:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
412
- 2024-07-11 23:31:35 | INFO | stdout | INFO: 10.140.60.209:46900 - "POST /worker_get_status HTTP/1.1" 200 OK
413
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:46920 - "POST /worker_get_status HTTP/1.1" 200 OK
414
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:46940 - "POST /worker_get_status HTTP/1.1" 200 OK
415
- 2024-07-11 23:31:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
416
- 2024-07-11 23:31:51 | INFO | stdout | INFO: 10.140.60.209:46976 - "POST /worker_get_status HTTP/1.1" 200 OK
417
- 2024-07-11 23:32:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
418
- 2024-07-11 23:32:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
419
- 2024-07-11 23:32:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
420
- 2024-07-11 23:32:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
421
- 2024-07-11 23:33:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
422
- 2024-07-11 23:33:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
423
- 2024-07-11 23:33:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
424
- 2024-07-11 23:33:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
425
- 2024-07-11 23:34:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
426
- 2024-07-11 23:34:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
427
- 2024-07-11 23:34:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
428
- 2024-07-11 23:34:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
429
- 2024-07-11 23:35:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
430
- 2024-07-11 23:35:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
431
- 2024-07-11 23:35:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
432
- 2024-07-11 23:35:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
433
- 2024-07-11 23:36:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
434
- 2024-07-11 23:36:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
435
- 2024-07-11 23:36:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
436
- 2024-07-11 23:36:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
437
- 2024-07-11 23:37:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
438
- 2024-07-11 23:37:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
439
- 2024-07-11 23:37:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
440
- 2024-07-11 23:37:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
441
- 2024-07-11 23:38:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
442
- 2024-07-11 23:38:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
443
- 2024-07-11 23:38:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
444
- 2024-07-11 23:38:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
445
- 2024-07-11 23:39:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
446
- 2024-07-11 23:39:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
447
- 2024-07-11 23:39:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
448
- 2024-07-11 23:39:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
449
- 2024-07-11 23:40:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
450
- 2024-07-11 23:40:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
451
- 2024-07-11 23:40:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
452
- 2024-07-11 23:40:41 | INFO | stdout | INFO: 10.140.60.209:50364 - "POST /worker_get_status HTTP/1.1" 200 OK
453
- 2024-07-11 23:40:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
454
- 2024-07-11 23:41:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
455
- 2024-07-11 23:41:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
456
- 2024-07-11 23:41:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
457
- 2024-07-11 23:41:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
458
- 2024-07-11 23:42:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
459
- 2024-07-11 23:42:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
460
- 2024-07-11 23:42:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
461
- 2024-07-11 23:42:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
462
- 2024-07-11 23:43:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
463
- 2024-07-11 23:43:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
464
- 2024-07-11 23:43:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
465
- 2024-07-11 23:43:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
466
- 2024-07-11 23:44:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
467
- 2024-07-11 23:44:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
468
- 2024-07-11 23:44:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
469
- 2024-07-11 23:44:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
470
- 2024-07-11 23:45:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
471
- 2024-07-11 23:45:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
472
- 2024-07-11 23:45:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
473
- 2024-07-11 23:45:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
474
- 2024-07-11 23:46:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
475
- 2024-07-11 23:46:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
476
- 2024-07-11 23:46:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
477
- 2024-07-11 23:46:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
478
- 2024-07-11 23:47:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
479
- 2024-07-11 23:47:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
480
- 2024-07-11 23:47:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
481
- 2024-07-11 23:47:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
482
- 2024-07-11 23:48:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
483
- 2024-07-11 23:48:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
484
- 2024-07-11 23:48:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
485
- 2024-07-11 23:48:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
486
- 2024-07-11 23:49:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
487
- 2024-07-11 23:49:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
488
- 2024-07-11 23:49:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
489
- 2024-07-11 23:49:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
490
- 2024-07-11 23:50:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
491
- 2024-07-11 23:50:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
492
- 2024-07-11 23:50:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
493
- 2024-07-11 23:50:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
494
- 2024-07-11 23:51:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
495
- 2024-07-11 23:51:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
496
- 2024-07-11 23:51:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
497
- 2024-07-11 23:51:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
498
- 2024-07-11 23:52:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
499
- 2024-07-11 23:52:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
500
- 2024-07-11 23:52:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
501
- 2024-07-11 23:52:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
502
- 2024-07-11 23:53:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
503
- 2024-07-11 23:53:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
504
- 2024-07-11 23:53:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
505
- 2024-07-11 23:53:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
506
- 2024-07-11 23:54:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
507
- 2024-07-11 23:54:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
508
- 2024-07-11 23:54:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
509
- 2024-07-11 23:54:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
510
- 2024-07-11 23:55:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
511
- 2024-07-11 23:55:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
512
- 2024-07-11 23:55:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
513
- 2024-07-11 23:55:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
514
- 2024-07-11 23:56:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
515
- 2024-07-11 23:56:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
516
- 2024-07-11 23:56:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
517
- 2024-07-11 23:56:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
518
- 2024-07-11 23:57:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
519
- 2024-07-11 23:57:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
520
- 2024-07-11 23:57:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
521
- 2024-07-11 23:57:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
522
- 2024-07-11 23:58:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
523
- 2024-07-11 23:58:09 | INFO | stdout | INFO: 10.140.60.209:57250 - "POST /worker_get_status HTTP/1.1" 200 OK
524
- 2024-07-11 23:58:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
525
- 2024-07-11 23:58:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
526
- 2024-07-11 23:58:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
527
- 2024-07-11 23:59:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
528
- 2024-07-11 23:59:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
529
- 2024-07-11 23:59:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
530
- 2024-07-11 23:59:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
531
- 2024-07-12 00:00:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
532
- 2024-07-12 00:00:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
533
- 2024-07-12 00:00:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
534
- 2024-07-12 00:00:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
535
- 2024-07-12 00:01:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
536
- 2024-07-12 00:01:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
537
- 2024-07-12 00:01:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
538
- 2024-07-12 00:01:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
539
- 2024-07-12 00:02:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
540
- 2024-07-12 00:02:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
541
- 2024-07-12 00:02:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
542
- 2024-07-12 00:02:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
543
- 2024-07-12 00:03:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
544
- 2024-07-12 00:03:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
545
- 2024-07-12 00:03:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
546
- 2024-07-12 00:03:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_55a7c0.log DELETED
@@ -1,614 +0,0 @@
1
- 2024-07-10 18:12:07 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.60.182:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-78B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 18:12:07 | INFO | model_worker | Loading the model InternVL2-78B on worker 55a7c0 ...
3
- 2024-07-10 18:12:08 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 18:12:08 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 18:12:18 | ERROR | stderr |
6
- 2024-07-10 18:12:20 | ERROR | stderr |
7
- 2024-07-10 18:12:22 | ERROR | stderr |
8
- 2024-07-10 18:12:24 | ERROR | stderr |
9
- 2024-07-10 18:12:26 | ERROR | stderr |
10
- 2024-07-10 18:12:28 | ERROR | stderr |
11
- 2024-07-10 18:12:30 | ERROR | stderr |
12
- 2024-07-10 18:12:32 | ERROR | stderr |
13
- 2024-07-10 18:12:34 | ERROR | stderr |
14
- 2024-07-10 18:12:36 | ERROR | stderr |
15
- 2024-07-10 18:12:38 | ERROR | stderr |
16
- 2024-07-10 18:12:40 | ERROR | stderr |
17
- 2024-07-10 18:12:42 | ERROR | stderr |
18
- 2024-07-10 18:12:44 | ERROR | stderr |
19
- 2024-07-10 18:12:46 | ERROR | stderr |
20
- 2024-07-10 18:12:48 | ERROR | stderr |
21
- 2024-07-10 18:12:50 | ERROR | stderr |
22
- 2024-07-10 18:12:52 | ERROR | stderr |
23
- 2024-07-10 18:12:54 | ERROR | stderr |
24
- 2024-07-10 18:12:55 | ERROR | stderr |
25
- 2024-07-10 18:12:57 | ERROR | stderr |
26
- 2024-07-10 18:12:59 | ERROR | stderr |
27
- 2024-07-10 18:13:01 | ERROR | stderr |
28
- 2024-07-10 18:13:02 | ERROR | stderr |
29
- 2024-07-10 18:13:04 | ERROR | stderr |
30
- 2024-07-10 18:13:06 | ERROR | stderr |
31
- 2024-07-10 18:13:08 | ERROR | stderr |
32
- 2024-07-10 18:13:09 | ERROR | stderr |
33
- 2024-07-10 18:13:11 | ERROR | stderr |
34
- 2024-07-10 18:13:13 | ERROR | stderr |
35
- 2024-07-10 18:13:15 | ERROR | stderr |
36
- 2024-07-10 18:13:16 | ERROR | stderr |
37
- 2024-07-10 18:13:18 | ERROR | stderr |
38
- 2024-07-10 18:13:19 | ERROR | stderr |
39
- 2024-07-10 18:13:19 | ERROR | stderr |
40
- 2024-07-10 18:13:19 | ERROR | stderr |
41
- 2024-07-10 18:13:20 | INFO | model_worker | Register to controller
42
- 2024-07-10 18:13:20 | ERROR | stderr | INFO: Started server process [118893]
43
- 2024-07-10 18:13:20 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-10 18:13:20 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-10 18:13:20 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40007 (Press CTRL+C to quit)
46
- 2024-07-10 18:13:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
47
- 2024-07-10 18:13:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
48
- 2024-07-10 18:14:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
49
- 2024-07-10 18:14:20 | INFO | stdout | INFO: 10.140.60.209:37325 - "POST /worker_get_status HTTP/1.1" 200 OK
50
- 2024-07-10 18:14:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
51
- 2024-07-10 18:14:23 | INFO | stdout | INFO: 10.140.60.209:37342 - "POST /worker_get_status HTTP/1.1" 200 OK
52
- 2024-07-10 18:14:24 | INFO | stdout | INFO: 10.140.60.209:37360 - "POST /worker_get_status HTTP/1.1" 200 OK
53
- 2024-07-10 18:14:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
54
- 2024-07-10 18:14:25 | INFO | stdout | INFO: 10.140.60.209:37366 - "POST /worker_generate_stream HTTP/1.1" 200 OK
55
- 2024-07-10 18:14:25 | INFO | stdout | history: []
56
- 2024-07-10 18:14:25 | INFO | stdout | question: Image-1: <image>
57
- 2024-07-10 18:14:25 | INFO | stdout | Describe this image in detail.
58
- 2024-07-10 18:14:25 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FC66068B5E0>]
59
- 2024-07-10 18:14:25 | INFO | model_worker | dynamic_image_size: True
60
- 2024-07-10 18:14:25 | INFO | model_worker | use_thumbnail: True
61
- 2024-07-10 18:14:25 | INFO | model_worker | Resize images to 448x448
62
- 2024-07-10 18:14:25 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
63
- 2024-07-10 18:14:26 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
64
- 2024-07-10 18:14:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
65
- 2024-07-10 18:14:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
66
- 2024-07-10 18:14:36 | INFO | stdout | INFO: 10.140.60.209:37396 - "POST /worker_get_status HTTP/1.1" 200 OK
67
- 2024-07-10 18:14:37 | INFO | stdout | INFO: 10.140.60.209:37414 - "POST /worker_get_status HTTP/1.1" 200 OK
68
- 2024-07-10 18:14:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
69
- 2024-07-10 18:15:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
70
- 2024-07-10 18:15:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
71
- 2024-07-10 18:15:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
72
- 2024-07-10 18:15:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
73
- 2024-07-10 18:16:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
74
- 2024-07-10 18:16:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
75
- 2024-07-10 18:16:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
76
- 2024-07-10 18:16:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
77
- 2024-07-10 18:16:57 | INFO | stdout | INFO: 10.140.60.209:37808 - "POST /worker_get_status HTTP/1.1" 200 OK
78
- 2024-07-10 18:17:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
79
- 2024-07-10 18:17:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
80
- 2024-07-10 18:17:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
81
- 2024-07-10 18:17:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
82
- 2024-07-10 18:18:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
83
- 2024-07-10 18:18:13 | INFO | stdout | INFO: 10.140.60.209:38064 - "POST /worker_get_status HTTP/1.1" 200 OK
84
- 2024-07-10 18:18:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
85
- 2024-07-10 18:18:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
86
- 2024-07-10 18:18:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
87
- 2024-07-10 18:19:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
88
- 2024-07-10 18:19:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
89
- 2024-07-10 18:19:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
90
- 2024-07-10 18:19:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
91
- 2024-07-10 18:20:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
92
- 2024-07-10 18:20:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
93
- 2024-07-10 18:20:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
94
- 2024-07-10 18:20:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
95
- 2024-07-10 18:21:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
96
- 2024-07-10 18:21:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
97
- 2024-07-10 18:21:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
98
- 2024-07-10 18:21:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
99
- 2024-07-10 18:22:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
100
- 2024-07-10 18:22:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
101
- 2024-07-10 18:22:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
102
- 2024-07-10 18:22:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
103
- 2024-07-10 18:23:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
104
- 2024-07-10 18:23:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
105
- 2024-07-10 18:23:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
106
- 2024-07-10 18:23:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
107
- 2024-07-10 18:24:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
108
- 2024-07-10 18:24:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
109
- 2024-07-10 18:24:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
110
- 2024-07-10 18:24:42 | INFO | stdout | INFO: 10.140.60.209:39396 - "POST /worker_get_status HTTP/1.1" 200 OK
111
- 2024-07-10 18:24:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
112
- 2024-07-10 18:24:57 | INFO | stdout | INFO: 10.140.60.209:39422 - "POST /worker_get_status HTTP/1.1" 200 OK
113
- 2024-07-10 18:25:03 | INFO | stdout | INFO: 10.140.60.209:39442 - "POST /worker_get_status HTTP/1.1" 200 OK
114
- 2024-07-10 18:25:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
115
- 2024-07-10 18:25:18 | INFO | stdout | INFO: 10.140.60.209:39598 - "POST /worker_get_status HTTP/1.1" 200 OK
116
- 2024-07-10 18:25:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
117
- 2024-07-10 18:25:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
118
- 2024-07-10 18:25:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
119
- 2024-07-10 18:26:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
120
- 2024-07-10 18:26:08 | INFO | stdout | INFO: 10.140.60.209:39676 - "POST /worker_get_status HTTP/1.1" 200 OK
121
- 2024-07-10 18:26:16 | INFO | stdout | INFO: 10.140.60.209:39801 - "POST /worker_get_status HTTP/1.1" 200 OK
122
- 2024-07-10 18:26:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
123
- 2024-07-10 18:26:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
124
- 2024-07-10 18:26:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
125
- 2024-07-10 18:27:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
126
- 2024-07-10 18:27:18 | INFO | stdout | INFO: 10.140.60.209:40068 - "POST /worker_get_status HTTP/1.1" 200 OK
127
- 2024-07-10 18:27:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
128
- 2024-07-10 18:27:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
129
- 2024-07-10 18:27:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
130
- 2024-07-10 18:28:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
131
- 2024-07-10 18:28:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
132
- 2024-07-10 18:28:25 | INFO | stdout | INFO: 10.140.60.209:40316 - "POST /worker_get_status HTTP/1.1" 200 OK
133
- 2024-07-10 18:28:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
134
- 2024-07-10 18:28:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
135
- 2024-07-10 18:28:56 | INFO | stdout | INFO: 10.140.60.209:40356 - "POST /worker_get_status HTTP/1.1" 200 OK
136
- 2024-07-10 18:29:05 | INFO | stdout | INFO: 10.140.60.209:40382 - "POST /worker_get_status HTTP/1.1" 200 OK
137
- 2024-07-10 18:29:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
138
- 2024-07-10 18:29:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
139
- 2024-07-10 18:29:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
140
- 2024-07-10 18:29:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
141
- 2024-07-10 18:30:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
142
- 2024-07-10 18:30:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
143
- 2024-07-10 18:30:34 | INFO | stdout | INFO: 10.140.60.209:40778 - "POST /worker_get_status HTTP/1.1" 200 OK
144
- 2024-07-10 18:30:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
145
- 2024-07-10 18:30:40 | INFO | stdout | INFO: 10.140.60.209:40800 - "POST /worker_get_status HTTP/1.1" 200 OK
146
- 2024-07-10 18:30:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
147
- 2024-07-10 18:31:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
148
- 2024-07-10 18:31:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
149
- 2024-07-10 18:31:23 | INFO | stdout | INFO: 10.140.60.209:40990 - "POST /worker_get_status HTTP/1.1" 200 OK
150
- 2024-07-10 18:31:31 | INFO | stdout | INFO: 10.140.60.209:41010 - "POST /worker_get_status HTTP/1.1" 200 OK
151
- 2024-07-10 18:31:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
152
- 2024-07-10 18:31:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
153
- 2024-07-10 18:32:02 | INFO | stdout | INFO: 10.140.60.209:41058 - "POST /worker_get_status HTTP/1.1" 200 OK
154
- 2024-07-10 18:32:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
155
- 2024-07-10 18:32:12 | INFO | stdout | INFO: 10.140.60.209:41084 - "POST /worker_get_status HTTP/1.1" 200 OK
156
- 2024-07-10 18:32:19 | INFO | stdout | INFO: 10.140.60.209:41268 - "POST /worker_get_status HTTP/1.1" 200 OK
157
- 2024-07-10 18:32:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
158
- 2024-07-10 18:32:22 | INFO | stdout | INFO: 10.140.60.209:41290 - "POST /worker_get_status HTTP/1.1" 200 OK
159
- 2024-07-10 18:32:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
160
- 2024-07-10 18:32:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
161
- 2024-07-10 18:33:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
162
- 2024-07-10 18:33:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
163
- 2024-07-10 18:33:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
164
- 2024-07-10 18:33:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
165
- 2024-07-10 18:34:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
166
- 2024-07-10 18:34:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
167
- 2024-07-10 18:34:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
168
- 2024-07-10 18:34:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
169
- 2024-07-10 18:35:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
170
- 2024-07-10 18:35:17 | INFO | stdout | INFO: 10.140.60.209:41850 - "POST /worker_get_status HTTP/1.1" 200 OK
171
- 2024-07-10 18:35:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
172
- 2024-07-10 18:35:25 | INFO | stdout | INFO: 10.140.60.209:41903 - "POST /worker_get_status HTTP/1.1" 200 OK
173
- 2024-07-10 18:35:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
174
- 2024-07-10 18:35:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
175
- 2024-07-10 18:36:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
176
- 2024-07-10 18:36:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
177
- 2024-07-10 18:36:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
178
- 2024-07-10 18:36:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
179
- 2024-07-10 18:37:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
180
- 2024-07-10 18:37:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
181
- 2024-07-10 18:37:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
182
- 2024-07-10 18:37:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
183
- 2024-07-10 18:38:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
184
- 2024-07-10 18:38:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
185
- 2024-07-10 18:38:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
186
- 2024-07-10 18:38:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
187
- 2024-07-10 18:39:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
188
- 2024-07-10 18:39:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
189
- 2024-07-10 18:39:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
190
- 2024-07-10 18:39:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
191
- 2024-07-10 18:39:57 | INFO | stdout | INFO: 10.140.60.209:42698 - "POST /worker_get_status HTTP/1.1" 200 OK
192
- 2024-07-10 18:40:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
193
- 2024-07-10 18:40:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
194
- 2024-07-10 18:40:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
195
- 2024-07-10 18:40:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
196
- 2024-07-10 18:40:59 | INFO | stdout | INFO: 10.140.60.209:42954 - "POST /worker_get_status HTTP/1.1" 200 OK
197
- 2024-07-10 18:41:02 | INFO | stdout | INFO: 10.140.60.209:42974 - "POST /worker_get_status HTTP/1.1" 200 OK
198
- 2024-07-10 18:41:03 | INFO | stdout | INFO: 10.140.60.209:42998 - "POST /worker_get_status HTTP/1.1" 200 OK
199
- 2024-07-10 18:41:04 | INFO | stdout | INFO: 10.140.60.209:43018 - "POST /worker_get_status HTTP/1.1" 200 OK
200
- 2024-07-10 18:41:06 | INFO | stdout | INFO: 10.140.60.209:43038 - "POST /worker_get_status HTTP/1.1" 200 OK
201
- 2024-07-10 18:41:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
202
- 2024-07-10 18:41:08 | INFO | stdout | INFO: 10.140.60.209:43060 - "POST /worker_get_status HTTP/1.1" 200 OK
203
- 2024-07-10 18:41:13 | INFO | stdout | INFO: 10.140.60.209:43125 - "POST /worker_get_status HTTP/1.1" 200 OK
204
- 2024-07-10 18:41:14 | INFO | stdout | INFO: 10.140.60.209:43158 - "POST /worker_get_status HTTP/1.1" 200 OK
205
- 2024-07-10 18:41:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
206
- 2024-07-10 18:41:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
207
- 2024-07-10 18:41:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
208
- 2024-07-10 18:42:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
209
- 2024-07-10 18:42:15 | INFO | stdout | INFO: 10.140.60.209:43408 - "POST /worker_get_status HTTP/1.1" 200 OK
210
- 2024-07-10 18:42:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
211
- 2024-07-10 18:42:30 | INFO | stdout | INFO: 10.140.60.209:43512 - "POST /worker_get_status HTTP/1.1" 200 OK
212
- 2024-07-10 18:42:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
213
- 2024-07-10 18:42:38 | INFO | stdout | INFO: 10.140.60.209:43540 - "POST /worker_get_status HTTP/1.1" 200 OK
214
- 2024-07-10 18:42:48 | INFO | stdout | INFO: 10.140.60.209:43576 - "POST /worker_get_status HTTP/1.1" 200 OK
215
- 2024-07-10 18:42:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
216
- 2024-07-10 18:42:58 | INFO | stdout | INFO: 10.140.60.209:43604 - "POST /worker_get_status HTTP/1.1" 200 OK
217
- 2024-07-10 18:43:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
218
- 2024-07-10 18:43:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
219
- 2024-07-10 18:43:24 | INFO | stdout | INFO: 10.140.60.209:43792 - "POST /worker_get_status HTTP/1.1" 200 OK
220
- 2024-07-10 18:43:25 | INFO | stdout | INFO: 10.140.60.209:43812 - "POST /worker_get_status HTTP/1.1" 200 OK
221
- 2024-07-10 18:43:30 | INFO | stdout | INFO: 10.140.60.209:43834 - "POST /worker_get_status HTTP/1.1" 200 OK
222
- 2024-07-10 18:43:34 | INFO | stdout | INFO: 10.140.60.209:43854 - "POST /worker_get_status HTTP/1.1" 200 OK
223
- 2024-07-10 18:43:35 | INFO | stdout | INFO: 10.140.60.209:43874 - "POST /worker_get_status HTTP/1.1" 200 OK
224
- 2024-07-10 18:43:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
225
- 2024-07-10 18:43:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
226
- 2024-07-10 18:43:57 | INFO | stdout | INFO: 10.140.60.209:43910 - "POST /worker_get_status HTTP/1.1" 200 OK
227
- 2024-07-10 18:44:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
228
- 2024-07-10 18:44:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
229
- 2024-07-10 18:44:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
230
- 2024-07-10 18:44:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
231
- 2024-07-10 18:45:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
232
- 2024-07-10 18:45:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
233
- 2024-07-10 18:45:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
234
- 2024-07-10 18:45:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
235
- 2024-07-10 18:46:02 | INFO | stdout | INFO: 10.140.60.209:44332 - "POST /worker_get_status HTTP/1.1" 200 OK
236
- 2024-07-10 18:46:03 | INFO | stdout | INFO: 10.140.60.209:44352 - "POST /worker_get_status HTTP/1.1" 200 OK
237
- 2024-07-10 18:46:07 | INFO | stdout | INFO: 10.140.60.209:44372 - "POST /worker_get_status HTTP/1.1" 200 OK
238
- 2024-07-10 18:46:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
239
- 2024-07-10 18:46:21 | INFO | stdout | INFO: 10.140.60.209:44564 - "POST /worker_get_status HTTP/1.1" 200 OK
240
- 2024-07-10 18:46:22 | INFO | stdout | INFO: 10.140.60.209:44584 - "POST /worker_get_status HTTP/1.1" 200 OK
241
- 2024-07-10 18:46:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
242
- 2024-07-10 18:46:23 | INFO | stdout | INFO: 10.140.60.209:44604 - "POST /worker_get_status HTTP/1.1" 200 OK
243
- 2024-07-10 18:46:28 | INFO | stdout | INFO: 10.140.60.209:44634 - "POST /worker_get_status HTTP/1.1" 200 OK
244
- 2024-07-10 18:46:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
245
- 2024-07-10 18:46:44 | INFO | stdout | INFO: 10.140.60.209:44734 - "POST /worker_get_status HTTP/1.1" 200 OK
246
- 2024-07-10 18:46:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
247
- 2024-07-10 18:46:56 | INFO | stdout | INFO: 10.140.60.209:44778 - "POST /worker_get_status HTTP/1.1" 200 OK
248
- 2024-07-10 18:46:59 | INFO | stdout | INFO: 10.140.60.209:44802 - "POST /worker_get_status HTTP/1.1" 200 OK
249
- 2024-07-10 18:46:59 | INFO | stdout | INFO: 10.140.60.209:44822 - "POST /worker_get_status HTTP/1.1" 200 OK
250
- 2024-07-10 18:47:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
251
- 2024-07-10 18:47:09 | INFO | stdout | INFO: 10.140.60.209:44848 - "POST /worker_get_status HTTP/1.1" 200 OK
252
- 2024-07-10 18:47:14 | INFO | stdout | INFO: 10.140.60.209:44938 - "POST /worker_get_status HTTP/1.1" 200 OK
253
- 2024-07-10 18:47:21 | INFO | stdout | INFO: 10.140.60.209:45090 - "POST /worker_get_status HTTP/1.1" 200 OK
254
- 2024-07-10 18:47:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
255
- 2024-07-10 18:47:29 | INFO | stdout | INFO: 10.140.60.209:45126 - "POST /worker_get_status HTTP/1.1" 200 OK
256
- 2024-07-10 18:47:32 | INFO | stdout | INFO: 10.140.60.209:45164 - "POST /worker_get_status HTTP/1.1" 200 OK
257
- 2024-07-10 18:47:35 | INFO | stdout | INFO: 10.140.60.209:45184 - "POST /worker_get_status HTTP/1.1" 200 OK
258
- 2024-07-10 18:47:35 | INFO | stdout | INFO: 10.140.60.209:45204 - "POST /worker_get_status HTTP/1.1" 200 OK
259
- 2024-07-10 18:47:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
260
- 2024-07-10 18:47:35 | INFO | stdout | INFO: 10.140.60.209:45222 - "POST /worker_generate_stream HTTP/1.1" 200 OK
261
- 2024-07-10 18:47:35 | INFO | stdout | history: []
262
- 2024-07-10 18:47:35 | INFO | stdout | question: Image-1: <image>
263
- 2024-07-10 18:47:35 | INFO | stdout | 这是啥
264
- 2024-07-10 18:47:35 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x587 at 0x7FC660582B00>]
265
- 2024-07-10 18:47:35 | INFO | model_worker | dynamic_image_size: True
266
- 2024-07-10 18:47:35 | INFO | model_worker | use_thumbnail: True
267
- 2024-07-10 18:47:36 | INFO | model_worker | Resize images to 448x448
268
- 2024-07-10 18:47:36 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
269
- 2024-07-10 18:47:36 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
270
- 2024-07-10 18:47:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
271
- 2024-07-10 18:47:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
272
- 2024-07-10 18:48:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
273
- 2024-07-10 18:48:15 | INFO | stdout | INFO: 10.140.60.209:45390 - "POST /worker_get_status HTTP/1.1" 200 OK
274
- 2024-07-10 18:48:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
275
- 2024-07-10 18:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
276
- 2024-07-10 18:48:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
277
- 2024-07-10 18:48:47 | INFO | stdout | INFO: 10.140.60.209:45524 - "POST /worker_get_status HTTP/1.1" 200 OK
278
- 2024-07-10 18:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
279
- 2024-07-10 18:48:47 | INFO | stdout | INFO: 10.140.60.209:45532 - "POST /worker_generate_stream HTTP/1.1" 200 OK
280
- 2024-07-10 18:48:47 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一张展示八只不同品种的狗的照片。这些狗并排坐在一张长椅上，背景是蓝天和绿地。具体来说，这些狗的品种包括：\n\n1. 黑色卷毛狗：可能是贵宾犬（Poodle）。\n2. 棕色长毛狗：可能是德国牧羊犬（German Shepherd）。\n3. 白色长毛狗：可能是西高地白梗犬（West Highland White Terrier）。\n4. 棕色长毛狗：可能是英国可卡犬（English Cocker Spaniel）。\n5. 白色和棕色的狗：可能是比格犬（Beagle）。\n6. 灰色和白色的小狗：可能是法国斗牛犬（French Bulldog）。\n7. 棕色和白色的小狗：可能是法国斗牛犬（French Bulldog）。\n8. 白色和棕色的小狗：可能是比格犬（Beagle）。\n\n这些狗看起来都很健康，而且很享受在户外的时光。']]
281
- 2024-07-10 18:48:47 | INFO | stdout | question: 请检测图中所有的狗，并给出坐标框
282
- 2024-07-10 18:48:47 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x587 at 0x7FC660583220>]
283
- 2024-07-10 18:48:47 | INFO | model_worker | dynamic_image_size: True
284
- 2024-07-10 18:48:47 | INFO | model_worker | use_thumbnail: True
285
- 2024-07-10 18:48:47 | INFO | model_worker | Resize images to 448x448
286
- 2024-07-10 18:48:47 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
287
- 2024-07-10 18:48:48 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
288
- 2024-07-10 18:48:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
289
- 2024-07-10 18:49:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
290
- 2024-07-10 18:49:12 | INFO | stdout | INFO: 10.140.60.209:45580 - "POST /worker_get_status HTTP/1.1" 200 OK
291
- 2024-07-10 18:49:16 | INFO | stdout | INFO: 10.140.60.209:45691 - "POST /worker_get_status HTTP/1.1" 200 OK
292
- 2024-07-10 18:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
293
- 2024-07-10 18:49:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
294
- 2024-07-10 18:49:25 | INFO | stdout | INFO: 10.140.60.209:45772 - "POST /worker_get_status HTTP/1.1" 200 OK
295
- 2024-07-10 18:49:36 | INFO | stdout | INFO: 10.140.60.209:45800 - "POST /worker_get_status HTTP/1.1" 200 OK
296
- 2024-07-10 18:49:36 | INFO | stdout | INFO: 10.140.60.209:45820 - "POST /worker_get_status HTTP/1.1" 200 OK
297
- 2024-07-10 18:49:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
298
- 2024-07-10 18:49:36 | INFO | stdout | INFO: 10.140.60.209:45828 - "POST /worker_generate_stream HTTP/1.1" 200 OK
299
- 2024-07-10 18:49:36 | INFO | stdout | history: []
300
- 2024-07-10 18:49:36 | INFO | stdout | question: Image-1: <image>
301
- 2024-07-10 18:49:36 | INFO | stdout | 请检测图中所有的物体，并给出坐标框
302
- 2024-07-10 18:49:36 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=800x800 at 0x7FC660583700>]
303
- 2024-07-10 18:49:36 | INFO | model_worker | dynamic_image_size: True
304
- 2024-07-10 18:49:36 | INFO | model_worker | use_thumbnail: True
305
- 2024-07-10 18:49:36 | INFO | model_worker | Resize images to 448x448
306
- 2024-07-10 18:49:36 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
307
- 2024-07-10 18:49:37 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
308
- 2024-07-10 18:49:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
309
- 2024-07-10 18:49:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
310
- 2024-07-10 18:50:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
311
- 2024-07-10 18:50:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
312
- 2024-07-10 18:50:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
313
- 2024-07-10 18:50:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
314
- 2024-07-10 18:50:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
315
- 2024-07-10 18:51:06 | INFO | stdout | INFO: 10.140.60.209:46056 - "POST /worker_get_status HTTP/1.1" 200 OK
316
- 2024-07-10 18:51:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
317
- 2024-07-10 18:51:09 | INFO | stdout | INFO: 10.140.60.209:46078 - "POST /worker_get_status HTTP/1.1" 200 OK
318
- 2024-07-10 18:51:10 | INFO | stdout | INFO: 10.140.60.209:46098 - "POST /worker_get_status HTTP/1.1" 200 OK
319
- 2024-07-10 18:51:13 | INFO | stdout | INFO: 10.140.60.209:46150 - "POST /worker_get_status HTTP/1.1" 200 OK
320
- 2024-07-10 18:51:14 | INFO | stdout | INFO: 10.140.60.209:46192 - "POST /worker_get_status HTTP/1.1" 200 OK
321
- 2024-07-10 18:51:15 | INFO | stdout | INFO: 10.140.60.209:46240 - "POST /worker_get_status HTTP/1.1" 200 OK
322
- 2024-07-10 18:51:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
323
- 2024-07-10 18:51:18 | INFO | stdout | INFO: 10.140.60.209:46319 - "POST /worker_generate_stream HTTP/1.1" 200 OK
324
- 2024-07-10 18:51:18 | INFO | stdout | history: []
325
- 2024-07-10 18:51:18 | INFO | stdout | question: Image-1: <image>
326
- 2024-07-10 18:51:18 | INFO | stdout | 请检测图中所有的物体，并给出坐标框
327
- 2024-07-10 18:51:18 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC660583C40>]
328
- 2024-07-10 18:51:18 | INFO | model_worker | dynamic_image_size: True
329
- 2024-07-10 18:51:18 | INFO | model_worker | use_thumbnail: True
330
- 2024-07-10 18:51:19 | INFO | model_worker | Resize images to 448x448
331
- 2024-07-10 18:51:19 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
332
- 2024-07-10 18:51:20 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
333
- 2024-07-10 18:51:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
334
- 2024-07-10 18:51:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
335
- 2024-07-10 18:51:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
336
- 2024-07-10 18:51:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
337
- 2024-07-10 18:52:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
338
- 2024-07-10 18:52:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
339
- 2024-07-10 18:52:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
340
- 2024-07-10 18:52:45 | INFO | stdout | INFO: 10.140.60.209:46744 - "POST /worker_get_status HTTP/1.1" 200 OK
341
- 2024-07-10 18:52:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 6
342
- 2024-07-10 18:52:48 | INFO | stdout | INFO: 10.140.60.209:46754 - "POST /worker_generate_stream HTTP/1.1" 200 OK
343
- 2024-07-10 18:52:48 | INFO | stdout | history: [['Image-1: <image>\n请检测图中所有的物体，并给出坐标框', '好的，我会检测图中所有的物体，并给出坐标框。\n\n```\n<ref>柠檬茶</ref><box>[[382, 404, 619, 783]]</box>\n<ref>玻璃杯</ref><box>[[376, 338, 623, 804]]</box>\n<ref>杯子</ref><box>[[10, 342, 215, 645]]</box>\n<ref>容器，器皿</ref><box>[[0, 673, 677, 1000]]</box>\n<ref>方桌</ref><box>[[0, 584, 998, 1000]]</box>\n```\n']]
344
- 2024-07-10 18:52:48 | INFO | stdout | question: 请检测图中的<ref>冰块</ref>
345
- 2024-07-10 18:52:48 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC6605AD0F0>]
346
- 2024-07-10 18:52:48 | INFO | model_worker | dynamic_image_size: True
347
- 2024-07-10 18:52:48 | INFO | model_worker | use_thumbnail: True
348
- 2024-07-10 18:52:49 | INFO | model_worker | Resize images to 448x448
349
- 2024-07-10 18:52:49 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
350
- 2024-07-10 18:52:50 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
351
- 2024-07-10 18:52:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 6
352
- 2024-07-10 18:52:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
353
- 2024-07-10 18:53:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
354
- 2024-07-10 18:53:08 | INFO | stdout | INFO: 10.140.60.209:46778 - "POST /worker_get_status HTTP/1.1" 200 OK
355
- 2024-07-10 18:53:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
356
- 2024-07-10 18:53:12 | INFO | stdout | INFO: 10.140.60.209:46786 - "POST /worker_generate_stream HTTP/1.1" 200 OK
357
- 2024-07-10 18:53:12 | INFO | stdout | history: [['Image-1: <image>\n请检测图中所有的物体，并给出坐标框', '好的，我会检测图中所有的物体，并给出坐标框。\n\n```\n<ref>柠檬茶</ref><box>[[382, 404, 619, 783]]</box>\n<ref>玻璃杯</ref><box>[[376, 338, 623, 804]]</box>\n<ref>杯子</ref><box>[[10, 342, 215, 645]]</box>\n<ref>容器，器皿</ref><box>[[0, 673, 677, 1000]]</box>\n<ref>方桌</ref><box>[[0, 584, 998, 1000]]</box>\n```\n'], ['请检测图中的<ref>冰块</ref>', '图中可以看到四个冰块。其中三个冰块在桌子的右侧，另一个冰块在左侧的木制托盘上。']]
358
- 2024-07-10 18:53:12 | INFO | stdout | question: 请检测图中的<ref>冰块</ref>，并输出坐标框
359
- 2024-07-10 18:53:12 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC6605AD720>]
360
- 2024-07-10 18:53:12 | INFO | model_worker | dynamic_image_size: True
361
- 2024-07-10 18:53:12 | INFO | model_worker | use_thumbnail: True
362
- 2024-07-10 18:53:13 | INFO | model_worker | Resize images to 448x448
363
- 2024-07-10 18:53:13 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
364
- 2024-07-10 18:53:13 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
365
- 2024-07-10 18:53:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
366
- 2024-07-10 18:53:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
367
- 2024-07-10 18:53:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
368
- 2024-07-10 18:54:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
369
- 2024-07-10 18:54:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
370
- 2024-07-10 18:54:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
371
- 2024-07-10 18:54:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
372
- 2024-07-10 18:54:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
373
- 2024-07-10 18:54:54 | INFO | stdout | INFO: 10.140.60.209:47354 - "POST /worker_get_status HTTP/1.1" 200 OK
374
- 2024-07-10 18:54:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
375
- 2024-07-10 18:54:58 | INFO | stdout | INFO: 10.140.60.209:47364 - "POST /worker_generate_stream HTTP/1.1" 200 OK
376
- 2024-07-10 18:54:58 | INFO | stdout | history: [['Image-1: <image>\n请检测图中所有的物体，并给出坐标框', '好的，我会检测图中所有的物体，并给出坐标框。\n\n```\n<ref>柠檬茶</ref><box>[[382, 404, 619, 783]]</box>\n<ref>玻璃杯</ref><box>[[376, 338, 623, 804]]</box>\n<ref>杯子</ref><box>[[10, 342, 215, 645]]</box>\n<ref>容器，器皿</ref><box>[[0, 673, 677, 1000]]</box>\n<ref>方桌</ref><box>[[0, 584, 998, 1000]]</box>\n```\n'], ['请检测图中的<ref>冰块</ref>', '图中可以看到四个冰块。其中三个冰块在桌子的右侧，另一个冰块在左侧的木制托盘上。'], ['请检测图中的<ref>冰块</ref>，并输出坐标框', '为了检测图中的冰块并输出坐标框，我们可以使用图像处理技术。以下是每个冰块的坐标框：\n\n1. **冰块1**（在木托盘上）\n - 左上角坐标：(250, 600)\n - 右下角坐标：(340, 730)\n\n2. **冰块2**（在木托盘右边）\n - 左上角坐标：(690, 620)\n - 右下角坐标：(770, 750)\n\n3. **冰块3**（在背景，靠右）\n - 左上角坐标：(770, 520)\n - 右下角坐标：(840, 650)\n\n这些坐标框可以帮助我们定位和识别图中的冰块。']]
377
- 2024-07-10 18:54:58 | INFO | stdout | question: 组织成<ref>class name</ref><box>[[x1, y1, x2, y2], ...]</box>的格式
378
- 2024-07-10 18:54:58 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC660580AF0>]
379
- 2024-07-10 18:54:58 | INFO | model_worker | dynamic_image_size: True
380
- 2024-07-10 18:54:58 | INFO | model_worker | use_thumbnail: True
381
- 2024-07-10 18:54:59 | INFO | model_worker | Resize images to 448x448
382
- 2024-07-10 18:54:59 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
383
- 2024-07-10 18:54:59 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
384
- 2024-07-10 18:55:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
385
- 2024-07-10 18:55:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
386
- 2024-07-10 18:55:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
387
- 2024-07-10 18:55:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
388
- 2024-07-10 18:55:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
389
- 2024-07-10 18:56:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
390
- 2024-07-10 18:56:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
391
- 2024-07-10 18:56:38 | INFO | stdout | INFO: 10.140.60.209:47870 - "POST /worker_get_status HTTP/1.1" 200 OK
392
- 2024-07-10 18:56:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
393
- 2024-07-10 18:56:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
394
- 2024-07-10 18:56:56 | INFO | stdout | INFO: 10.140.60.209:47894 - "POST /worker_get_status HTTP/1.1" 200 OK
395
- 2024-07-10 18:57:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
396
- 2024-07-10 18:57:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
397
- 2024-07-10 18:57:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
398
- 2024-07-10 18:57:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
399
- 2024-07-10 18:58:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
400
- 2024-07-10 18:58:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
401
- 2024-07-10 18:58:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
402
- 2024-07-10 18:58:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
403
- 2024-07-10 18:59:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
404
- 2024-07-10 18:59:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
405
- 2024-07-10 18:59:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
406
- 2024-07-10 18:59:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
407
- 2024-07-10 19:00:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
408
- 2024-07-10 19:00:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
409
- 2024-07-10 19:00:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
410
- 2024-07-10 19:00:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
411
- 2024-07-10 19:01:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
412
- 2024-07-10 19:01:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
413
- 2024-07-10 19:01:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
414
- 2024-07-10 19:01:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
415
- 2024-07-10 19:02:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
416
- 2024-07-10 19:02:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
417
- 2024-07-10 19:02:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
418
- 2024-07-10 19:02:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
419
- 2024-07-10 19:03:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
420
- 2024-07-10 19:03:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
421
- 2024-07-10 19:03:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
422
- 2024-07-10 19:03:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
423
- 2024-07-10 19:04:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
424
- 2024-07-10 19:04:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
425
- 2024-07-10 19:04:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
426
- 2024-07-10 19:04:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
427
- 2024-07-10 19:05:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
428
- 2024-07-10 19:05:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
429
- 2024-07-10 19:05:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
430
- 2024-07-10 19:05:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
431
- 2024-07-10 19:06:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
432
- 2024-07-10 19:06:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
433
- 2024-07-10 19:06:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
434
- 2024-07-10 19:06:51 | INFO | stdout | INFO: 10.140.60.209:50640 - "POST /worker_get_status HTTP/1.1" 200 OK
435
- 2024-07-10 19:06:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
436
- 2024-07-10 19:06:56 | INFO | stdout | INFO: 10.140.60.209:50660 - "POST /worker_get_status HTTP/1.1" 200 OK
437
- 2024-07-10 19:07:03 | INFO | stdout | INFO: 10.140.60.209:50696 - "POST /worker_get_status HTTP/1.1" 200 OK
438
- 2024-07-10 19:07:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
439
- 2024-07-10 19:07:03 | INFO | stdout | INFO: 10.140.60.209:50704 - "POST /worker_generate_stream HTTP/1.1" 200 OK
440
- 2024-07-10 19:07:03 | INFO | stdout | history: []
441
- 2024-07-10 19:07:03 | INFO | stdout | question: Image-1: <image>
442
- 2024-07-10 19:07:03 | INFO | stdout | 详细描述这张图片
443
- 2024-07-10 19:07:03 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FC660582290>]
444
- 2024-07-10 19:07:03 | INFO | model_worker | dynamic_image_size: True
445
- 2024-07-10 19:07:03 | INFO | model_worker | use_thumbnail: True
446
- 2024-07-10 19:07:04 | INFO | model_worker | Resize images to 448x448
447
- 2024-07-10 19:07:04 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
448
- 2024-07-10 19:07:04 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
449
- 2024-07-10 19:07:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
450
- 2024-07-10 19:07:14 | INFO | stdout | INFO: 10.140.60.209:50802 - "POST /worker_get_status HTTP/1.1" 200 OK
451
- 2024-07-10 19:07:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
452
- 2024-07-10 19:07:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
453
- 2024-07-10 19:07:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
454
- 2024-07-10 19:07:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
455
- 2024-07-10 19:08:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
456
- 2024-07-10 19:08:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
457
- 2024-07-10 19:08:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
458
- 2024-07-10 19:08:40 | INFO | stdout | INFO: 10.140.60.209:51288 - "POST /worker_get_status HTTP/1.1" 200 OK
459
- 2024-07-10 19:08:44 | INFO | stdout | INFO: 10.140.60.209:51320 - "POST /worker_get_status HTTP/1.1" 200 OK
460
- 2024-07-10 19:08:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
461
- 2024-07-10 19:09:05 | INFO | stdout | INFO: 10.140.60.209:51426 - "POST /worker_get_status HTTP/1.1" 200 OK
462
- 2024-07-10 19:09:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
463
- 2024-07-10 19:09:16 | INFO | stdout | INFO: 10.140.60.209:51620 - "POST /worker_get_status HTTP/1.1" 200 OK
464
- 2024-07-10 19:09:17 | INFO | stdout | INFO: 10.140.60.209:51666 - "POST /worker_get_status HTTP/1.1" 200 OK
465
- 2024-07-10 19:09:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
466
- 2024-07-10 19:09:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
467
- 2024-07-10 19:09:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
468
- 2024-07-10 19:10:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
469
- 2024-07-10 19:10:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
470
- 2024-07-10 19:10:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
471
- 2024-07-10 19:10:51 | INFO | stdout | INFO: 10.140.60.209:52090 - "POST /worker_get_status HTTP/1.1" 200 OK
472
- 2024-07-10 19:10:52 | INFO | stdout | INFO: 10.140.60.209:52110 - "POST /worker_get_status HTTP/1.1" 200 OK
473
- 2024-07-10 19:10:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
474
- 2024-07-10 19:11:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
475
- 2024-07-10 19:11:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
476
- 2024-07-10 19:11:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
477
- 2024-07-10 19:11:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
478
- 2024-07-10 19:12:07 | INFO | stdout | INFO: 10.140.60.209:52410 - "POST /worker_get_status HTTP/1.1" 200 OK
479
- 2024-07-10 19:12:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
480
- 2024-07-10 19:12:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
481
- 2024-07-10 19:12:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
482
- 2024-07-10 19:12:44 | INFO | stdout | INFO: 10.140.60.209:52662 - "POST /worker_get_status HTTP/1.1" 200 OK
483
- 2024-07-10 19:12:44 | INFO | stdout | INFO: 10.140.60.209:52682 - "POST /worker_get_status HTTP/1.1" 200 OK
484
- 2024-07-10 19:12:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
485
- 2024-07-10 19:12:45 | INFO | stdout | INFO: 10.140.60.209:52690 - "POST /worker_generate_stream HTTP/1.1" 200 OK
486
- 2024-07-10 19:12:45 | INFO | stdout | history: []
487
- 2024-07-10 19:12:45 | INFO | stdout | question: Image-1: <image>
488
- 2024-07-10 19:12:45 | INFO | stdout | 请问这张图片用作微信头像怎么样？是一位什么样的人。
489
- 2024-07-10 19:12:45 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=940x940 at 0x7FC660582470>]
490
- 2024-07-10 19:12:45 | INFO | model_worker | dynamic_image_size: True
491
- 2024-07-10 19:12:45 | INFO | model_worker | use_thumbnail: True
492
- 2024-07-10 19:12:45 | INFO | model_worker | Resize images to 448x448
493
- 2024-07-10 19:12:45 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
494
- 2024-07-10 19:12:46 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
495
- 2024-07-10 19:12:50 | INFO | stdout | INFO: 10.140.60.209:52708 - "POST /worker_get_status HTTP/1.1" 200 OK
496
- 2024-07-10 19:12:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
497
- 2024-07-10 19:13:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
498
- 2024-07-10 19:13:17 | INFO | stdout | INFO: 10.140.60.209:52852 - "POST /worker_get_status HTTP/1.1" 200 OK
499
- 2024-07-10 19:13:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
500
- 2024-07-10 19:13:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
501
- 2024-07-10 19:13:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
502
- 2024-07-10 19:13:46 | INFO | stdout | INFO: 10.140.60.209:52948 - "POST /worker_get_status HTTP/1.1" 200 OK
503
- 2024-07-10 19:13:47 | INFO | stdout | INFO: 10.140.60.209:52974 - "POST /worker_get_status HTTP/1.1" 200 OK
504
- 2024-07-10 19:13:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
505
- 2024-07-10 19:14:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
506
- 2024-07-10 19:14:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
507
- 2024-07-10 19:14:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
508
- 2024-07-10 19:14:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
509
- 2024-07-10 19:15:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
510
- 2024-07-10 19:15:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
511
- 2024-07-10 19:15:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
512
- 2024-07-10 19:15:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
513
- 2024-07-10 19:16:02 | INFO | stdout | INFO: 10.140.60.209:53446 - "POST /worker_get_status HTTP/1.1" 200 OK
514
- 2024-07-10 19:16:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
515
- 2024-07-10 19:16:16 | INFO | stdout | INFO: 10.140.60.209:53574 - "POST /worker_get_status HTTP/1.1" 200 OK
516
- 2024-07-10 19:16:23 | INFO | stdout | INFO: 10.140.60.209:53666 - "POST /worker_get_status HTTP/1.1" 200 OK
517
- 2024-07-10 19:16:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
518
- 2024-07-10 19:16:31 | INFO | stdout | INFO: 10.140.60.209:53692 - "POST /worker_get_status HTTP/1.1" 200 OK
519
- 2024-07-10 19:16:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
520
- 2024-07-10 19:16:40 | INFO | stdout | INFO: 10.140.60.209:53714 - "POST /worker_get_status HTTP/1.1" 200 OK
521
- 2024-07-10 19:16:41 | INFO | stdout | INFO: 10.140.60.209:53736 - "POST /worker_get_status HTTP/1.1" 200 OK
522
- 2024-07-10 19:16:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
523
- 2024-07-10 19:17:00 | INFO | stdout | INFO: 10.140.60.209:53766 - "POST /worker_get_status HTTP/1.1" 200 OK
524
- 2024-07-10 19:17:04 | INFO | stdout | INFO: 10.140.60.209:53786 - "POST /worker_get_status HTTP/1.1" 200 OK
525
- 2024-07-10 19:17:08 | INFO | stdout | INFO: 10.140.60.209:53808 - "POST /worker_get_status HTTP/1.1" 200 OK
526
- 2024-07-10 19:17:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
527
- 2024-07-10 19:17:10 | INFO | stdout | INFO: 10.140.60.209:53828 - "POST /worker_get_status HTTP/1.1" 200 OK
528
- 2024-07-10 19:17:19 | INFO | stdout | INFO: 10.140.60.209:54028 - "POST /worker_get_status HTTP/1.1" 200 OK
529
- 2024-07-10 19:17:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
530
- 2024-07-10 19:17:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
531
- 2024-07-10 19:17:41 | INFO | stdout | INFO: 10.140.60.209:54058 - "POST /worker_get_status HTTP/1.1" 200 OK
532
- 2024-07-10 19:17:46 | INFO | stdout | INFO: 10.140.60.209:54078 - "POST /worker_get_status HTTP/1.1" 200 OK
533
- 2024-07-10 19:17:47 | INFO | stdout | INFO: 10.140.60.209:54098 - "POST /worker_get_status HTTP/1.1" 200 OK
534
- 2024-07-10 19:17:51 | INFO | stdout | INFO: 10.140.60.209:54120 - "POST /worker_get_status HTTP/1.1" 200 OK
535
- 2024-07-10 19:17:54 | INFO | stdout | INFO: 10.140.60.209:54142 - "POST /worker_get_status HTTP/1.1" 200 OK
536
- 2024-07-10 19:17:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
537
- 2024-07-10 19:17:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 11
538
- 2024-07-10 19:17:58 | INFO | stdout | INFO: 10.140.60.209:54150 - "POST /worker_generate_stream HTTP/1.1" 200 OK
539
- 2024-07-10 19:17:58 | INFO | stdout | history: [['Image-1: <image>\nImage-2: <image>\nImage-3: <image>\nImage-4: <image>\nImage-5: <image>\n数一下总共看到了几张图片', '在这张图片中，我总共看到了五张图片。 ']]
540
- 2024-07-10 19:17:58 | INFO | stdout | question: 分别描述这些图片
541
- 2024-07-10 19:17:58 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1039 at 0x7FC660583F40>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1800 at 0x7FC6605825F0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=571x1280 at 0x7FC660583190>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC660582470>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=800x800 at 0x7FC660581390>]
542
- 2024-07-10 19:17:58 | INFO | model_worker | dynamic_image_size: True
543
- 2024-07-10 19:17:58 | INFO | model_worker | use_thumbnail: True
544
- 2024-07-10 19:17:59 | INFO | model_worker | Resize images to 448x448
545
- 2024-07-10 19:17:59 | INFO | model_worker | Split images to torch.Size([34, 3, 448, 448])
546
- 2024-07-10 19:17:59 | WARNING | transformers.tokenization_utils_base | Token indices sequence length is longer than the specified maximum sequence length for this model (8777 > 8192). Running this sequence through the model will result in indexing errors
547
- 2024-07-10 19:17:59 | WARNING | transformers.tokenization_utils_base | Token indices sequence length is longer than the specified maximum sequence length for this model (8777 > 8192). Running this sequence through the model will result in indexing errors
548
- 2024-07-10 19:18:00 | INFO | stdout | INFO: 10.140.60.209:54168 - "POST /worker_get_status HTTP/1.1" 200 OK
549
- 2024-07-10 19:18:02 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
550
- 2024-07-10 19:18:02 | ERROR | stderr | Exception in thread Thread-13 (chat):
551
- 2024-07-10 19:18:02 | ERROR | stderr | Traceback (most recent call last):
552
- 2024-07-10 19:18:02 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
553
- 2024-07-10 19:18:03 | ERROR | stderr | self.run()
554
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/threading.py", line 946, in run
555
- 2024-07-10 19:18:03 | ERROR | stderr | self._target(*self._args, **self._kwargs)
556
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 283, in chat
557
- 2024-07-10 19:18:03 | ERROR | stderr | generation_output = self.generate(
558
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
559
- 2024-07-10 19:18:03 | ERROR | stderr | return func(*args, **kwargs)
560
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 333, in generate
561
- 2024-07-10 19:18:03 | ERROR | stderr | outputs = self.language_model.generate(
562
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
563
- 2024-07-10 19:18:03 | ERROR | stderr | return func(*args, **kwargs)
564
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/utils.py", line 1525, in generate
565
- 2024-07-10 19:18:03 | ERROR | stderr | return self.sample(
566
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/utils.py", line 2628, in sample
567
- 2024-07-10 19:18:03 | ERROR | stderr | outputs = self(
568
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
569
- 2024-07-10 19:18:03 | ERROR | stderr | return self._call_impl(*args, **kwargs)
570
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
571
- 2024-07-10 19:18:03 | ERROR | stderr | return forward_call(*args, **kwargs)
572
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 1173, in forward
573
- 2024-07-10 19:18:03 | ERROR | stderr | outputs = self.model(
574
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
575
- 2024-07-10 19:18:03 | ERROR | stderr | return self._call_impl(*args, **kwargs)
576
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
577
- 2024-07-10 19:18:03 | ERROR | stderr | return forward_call(*args, **kwargs)
578
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 1058, in forward
579
- 2024-07-10 19:18:03 | ERROR | stderr | layer_outputs = decoder_layer(
580
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
581
- 2024-07-10 19:18:03 | ERROR | stderr | return self._call_impl(*args, **kwargs)
582
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
583
- 2024-07-10 19:18:03 | ERROR | stderr | return forward_call(*args, **kwargs)
584
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/accelerate/hooks.py", line 166, in new_forward
585
- 2024-07-10 19:18:03 | ERROR | stderr | output = module._old_forward(*args, **kwargs)
586
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 773, in forward
587
- 2024-07-10 19:18:03 | ERROR | stderr | hidden_states, self_attn_weights, present_key_value = self.self_attn(
588
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
589
- 2024-07-10 19:18:03 | ERROR | stderr | return self._call_impl(*args, **kwargs)
590
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
591
- 2024-07-10 19:18:03 | ERROR | stderr | return forward_call(*args, **kwargs)
592
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/accelerate/hooks.py", line 166, in new_forward
593
- 2024-07-10 19:18:03 | ERROR | stderr | output = module._old_forward(*args, **kwargs)
594
- 2024-07-10 19:18:03 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 305, in forward
595
- 2024-07-10 19:18:03 | ERROR | stderr | attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query_states.dtype)
596
- 2024-07-10 19:18:03 | ERROR | stderr | torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 9.18 GiB. GPU 0 has a total capacty of 79.33 GiB of which 1.78 GiB is free. Including non-PyTorch memory, this process has 77.53 GiB memory in use. Of the allocated memory 75.90 GiB is allocated by PyTorch, and 1.10 GiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
597
- 2024-07-10 19:18:09 | INFO | stdout | Caught Unknown Error
598
- 2024-07-10 19:18:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
599
- 2024-07-10 19:18:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
600
- 2024-07-10 19:18:11 | INFO | stdout | INFO: 10.140.60.209:54190 - "POST /worker_get_status HTTP/1.1" 200 OK
601
- 2024-07-10 19:18:12 | INFO | stdout | INFO: 10.140.60.209:54224 - "POST /worker_get_status HTTP/1.1" 200 OK
602
- 2024-07-10 19:18:12 | INFO | stdout | INFO: 10.140.60.209:54252 - "POST /worker_get_status HTTP/1.1" 200 OK
603
- 2024-07-10 19:18:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 12
604
- 2024-07-10 19:18:16 | INFO | stdout | INFO: 10.140.60.209:54342 - "POST /worker_generate_stream HTTP/1.1" 200 OK
605
- 2024-07-10 19:18:16 | INFO | stdout | history: []
606
- 2024-07-10 19:18:16 | INFO | stdout | question: Image-1: <image>
607
- 2024-07-10 19:18:16 | INFO | stdout | 请检测图中所有物体，并输出坐标框
608
- 2024-07-10 19:18:16 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=4032x3024 at 0x7FC660583250>]
609
- 2024-07-10 19:18:16 | INFO | model_worker | dynamic_image_size: True
610
- 2024-07-10 19:18:16 | INFO | model_worker | use_thumbnail: True
611
- 2024-07-10 19:18:17 | INFO | model_worker | Resize images to 448x448
612
- 2024-07-10 19:18:17 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
613
- 2024-07-10 19:18:18 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
614
- 2024-07-10 19:18:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_578439.log DELETED
@@ -1,154 +0,0 @@
1
- 2024-07-10 17:32:54 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 17:32:54 | INFO | model_worker | Loading the model InternVL2-1B on worker 578439 ...
3
- 2024-07-10 17:32:54 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 17:32:54 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 17:32:58 | INFO | model_worker | Register to controller
6
- 2024-07-10 17:32:58 | ERROR | stderr | INFO: Started server process [129001]
7
- 2024-07-10 17:32:58 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 17:32:58 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 17:32:58 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 17:33:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
11
- 2024-07-10 17:33:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
12
- 2024-07-10 17:33:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
13
- 2024-07-10 17:33:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
14
- 2024-07-10 17:34:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
15
- 2024-07-10 17:34:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
16
- 2024-07-10 17:34:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
17
- 2024-07-10 17:34:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
18
- 2024-07-10 17:35:10 | INFO | stdout | INFO: 10.140.60.209:51128 - "POST /worker_get_status HTTP/1.1" 200 OK
19
- 2024-07-10 17:35:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
20
- 2024-07-10 17:35:15 | INFO | stdout | INFO: 10.140.60.209:51229 - "POST /worker_get_status HTTP/1.1" 200 OK
21
- 2024-07-10 17:35:19 | INFO | stdout | INFO: 10.140.60.209:51294 - "POST /worker_get_status HTTP/1.1" 200 OK
22
- 2024-07-10 17:35:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
23
- 2024-07-10 17:35:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
24
- 2024-07-10 17:35:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
25
- 2024-07-10 17:36:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
26
- 2024-07-10 17:36:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
27
- 2024-07-10 17:36:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
28
- 2024-07-10 17:36:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
29
- 2024-07-10 17:37:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
30
- 2024-07-10 17:37:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
31
- 2024-07-10 17:37:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
32
- 2024-07-10 17:37:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
33
- 2024-07-10 17:38:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
34
- 2024-07-10 17:38:15 | INFO | stdout | INFO: 10.140.60.209:51886 - "POST /worker_get_status HTTP/1.1" 200 OK
35
- 2024-07-10 17:38:17 | INFO | stdout | INFO: 10.140.60.209:51956 - "POST /worker_get_status HTTP/1.1" 200 OK
36
- 2024-07-10 17:38:26 | INFO | stdout | INFO: 10.140.60.209:52000 - "POST /worker_get_status HTTP/1.1" 200 OK
37
- 2024-07-10 17:38:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
38
- 2024-07-10 17:38:29 | INFO | stdout | INFO: 10.140.60.209:52016 - "POST /worker_get_status HTTP/1.1" 200 OK
39
- 2024-07-10 17:38:30 | INFO | stdout | INFO: 10.140.60.209:52030 - "POST /worker_get_status HTTP/1.1" 200 OK
40
- 2024-07-10 17:38:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
41
- 2024-07-10 17:38:50 | INFO | stdout | INFO: 10.140.60.209:52054 - "POST /worker_get_status HTTP/1.1" 200 OK
42
- 2024-07-10 17:38:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
43
- 2024-07-10 17:39:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
44
- 2024-07-10 17:39:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
45
- 2024-07-10 17:39:42 | INFO | stdout | INFO: 10.140.60.209:52258 - "POST /worker_get_status HTTP/1.1" 200 OK
46
- 2024-07-10 17:39:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
47
- 2024-07-10 17:39:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
48
- 2024-07-10 17:40:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
49
- 2024-07-10 17:40:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
50
- 2024-07-10 17:40:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
51
- 2024-07-10 17:40:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
52
- 2024-07-10 17:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
53
- 2024-07-10 17:41:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
54
- 2024-07-10 17:41:31 | INFO | stdout | INFO: 10.140.60.209:52672 - "POST /worker_get_status HTTP/1.1" 200 OK
55
- 2024-07-10 17:41:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
56
- 2024-07-10 17:41:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
57
- 2024-07-10 17:42:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
58
- 2024-07-10 17:42:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
59
- 2024-07-10 17:42:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
60
- 2024-07-10 17:42:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
61
- 2024-07-10 17:43:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
62
- 2024-07-10 17:43:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
63
- 2024-07-10 17:43:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
64
- 2024-07-10 17:43:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
65
- 2024-07-10 17:44:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
66
- 2024-07-10 17:44:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
67
- 2024-07-10 17:44:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
68
- 2024-07-10 17:44:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
69
- 2024-07-10 17:45:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
70
- 2024-07-10 17:45:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
71
- 2024-07-10 17:45:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
72
- 2024-07-10 17:45:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
73
- 2024-07-10 17:46:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
74
- 2024-07-10 17:46:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
75
- 2024-07-10 17:46:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
76
- 2024-07-10 17:46:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
77
- 2024-07-10 17:47:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
78
- 2024-07-10 17:47:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
79
- 2024-07-10 17:47:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
80
- 2024-07-10 17:47:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
81
- 2024-07-10 17:48:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
82
- 2024-07-10 17:48:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
83
- 2024-07-10 17:48:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
84
- 2024-07-10 17:48:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
85
- 2024-07-10 17:49:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
86
- 2024-07-10 17:49:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
87
- 2024-07-10 17:49:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
88
- 2024-07-10 17:49:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
89
- 2024-07-10 17:50:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
90
- 2024-07-10 17:50:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
91
- 2024-07-10 17:50:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
92
- 2024-07-10 17:50:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
93
- 2024-07-10 17:51:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
94
- 2024-07-10 17:51:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
95
- 2024-07-10 17:51:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
96
- 2024-07-10 17:52:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
97
- 2024-07-10 17:52:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
98
- 2024-07-10 17:52:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
99
- 2024-07-10 17:52:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
100
- 2024-07-10 17:53:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
101
- 2024-07-10 17:53:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
102
- 2024-07-10 17:53:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
103
- 2024-07-10 17:53:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
104
- 2024-07-10 17:54:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
105
- 2024-07-10 17:54:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
106
- 2024-07-10 17:54:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
107
- 2024-07-10 17:54:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
108
- 2024-07-10 17:55:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
109
- 2024-07-10 17:55:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
110
- 2024-07-10 17:55:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
111
- 2024-07-10 17:55:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
112
- 2024-07-10 17:56:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
113
- 2024-07-10 17:56:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
114
- 2024-07-10 17:56:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
115
- 2024-07-10 17:56:33 | INFO | stdout | INFO: 10.140.60.209:56368 - "POST /worker_get_status HTTP/1.1" 200 OK
116
- 2024-07-10 17:56:36 | INFO | stdout | INFO: 10.140.60.209:56390 - "POST /worker_get_status HTTP/1.1" 200 OK
117
- 2024-07-10 17:56:37 | INFO | stdout | INFO: 10.140.60.209:56408 - "POST /worker_get_status HTTP/1.1" 200 OK
118
- 2024-07-10 17:56:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
119
- 2024-07-10 17:57:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
120
- 2024-07-10 17:57:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
121
- 2024-07-10 17:57:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
122
- 2024-07-10 17:57:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
123
- 2024-07-10 17:58:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
124
- 2024-07-10 17:58:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
125
- 2024-07-10 17:58:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
126
- 2024-07-10 17:58:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
127
- 2024-07-10 17:59:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
128
- 2024-07-10 17:59:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
129
- 2024-07-10 17:59:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
130
- 2024-07-10 17:59:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
131
- 2024-07-10 18:00:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
132
- 2024-07-10 18:00:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
133
- 2024-07-10 18:00:15 | INFO | stdout | INFO: 10.140.60.209:57202 - "POST /worker_get_status HTTP/1.1" 200 OK
134
- 2024-07-10 18:00:18 | INFO | stdout | INFO: 10.140.60.209:57282 - "POST /worker_get_status HTTP/1.1" 200 OK
135
- 2024-07-10 18:00:19 | INFO | stdout | INFO: 10.140.60.209:57300 - "POST /worker_get_status HTTP/1.1" 200 OK
136
- 2024-07-10 18:00:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
137
- 2024-07-10 18:00:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
138
- 2024-07-10 18:01:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
139
- 2024-07-10 18:01:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
140
- 2024-07-10 18:01:30 | INFO | stdout | INFO: 10.140.60.209:57518 - "POST /worker_get_status HTTP/1.1" 200 OK
141
- 2024-07-10 18:01:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
142
- 2024-07-10 18:01:33 | INFO | stdout | INFO: 10.140.60.209:57532 - "POST /worker_get_status HTTP/1.1" 200 OK
143
- 2024-07-10 18:01:36 | INFO | stdout | INFO: 10.140.60.209:57548 - "POST /worker_get_status HTTP/1.1" 200 OK
144
- 2024-07-10 18:01:38 | INFO | stdout | INFO: 10.140.60.209:57564 - "POST /worker_get_status HTTP/1.1" 200 OK
145
- 2024-07-10 18:01:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
146
- 2024-07-10 18:02:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
147
- 2024-07-10 18:02:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
148
- 2024-07-10 18:02:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
149
- 2024-07-10 18:02:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
150
- 2024-07-10 18:03:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
151
- 2024-07-10 18:03:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
152
- 2024-07-10 18:03:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
153
- 2024-07-10 18:03:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
154
- 2024-07-10 18:04:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_588a2c.log DELETED
@@ -1,8 +0,0 @@
1
- 2024-07-10 17:41:17 | ERROR | stderr | usage: model_worker.py [-h] [--host HOST] [--port PORT]
2
- 2024-07-10 17:41:17 | ERROR | stderr | [--worker-address WORKER_ADDRESS]
3
- 2024-07-10 17:41:17 | ERROR | stderr | [--controller-address CONTROLLER_ADDRESS]
4
- 2024-07-10 17:41:17 | ERROR | stderr | [--model-path MODEL_PATH] [--model-name MODEL_NAME]
5
- 2024-07-10 17:41:17 | ERROR | stderr | [--device DEVICE]
6
- 2024-07-10 17:41:17 | ERROR | stderr | [--limit-model-concurrency LIMIT_MODEL_CONCURRENCY]
7
- 2024-07-10 17:41:17 | ERROR | stderr | [--stream-interval STREAM_INTERVAL] [--load-8bit]
8
- 2024-07-10 17:41:17 | ERROR | stderr | model_worker.py: error: unrecognized arguments: --load-in-8bit
 
 
 
 
 
 
 
 
 
logs/model_worker_5bf53a.log DELETED
@@ -1,111 +0,0 @@
1
- 2024-07-10 17:41:28 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40006, worker_address='http://10.140.60.25:40006', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-40B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=True)
2
- 2024-07-10 17:41:28 | INFO | model_worker | Loading the model InternVL2-40B on worker 5bf53a ...
3
- 2024-07-10 17:41:28 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 17:41:28 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 17:41:29 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 17:41:29 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 17:41:36 | ERROR | stderr |
8
- 2024-07-10 17:41:38 | ERROR | stderr |
9
- 2024-07-10 17:41:40 | ERROR | stderr |
10
- 2024-07-10 17:41:42 | ERROR | stderr |
11
- 2024-07-10 17:41:44 | ERROR | stderr |
12
- 2024-07-10 17:41:47 | ERROR | stderr |
13
- 2024-07-10 17:41:49 | ERROR | stderr |
14
- 2024-07-10 17:41:51 | ERROR | stderr |
15
- 2024-07-10 17:41:53 | ERROR | stderr |
16
- 2024-07-10 17:41:55 | ERROR | stderr |
17
- 2024-07-10 17:41:57 | ERROR | stderr |
18
- 2024-07-10 17:41:59 | ERROR | stderr |
19
- 2024-07-10 17:42:02 | ERROR | stderr |
20
- 2024-07-10 17:42:04 | ERROR | stderr |
21
- 2024-07-10 17:42:06 | ERROR | stderr |
22
- 2024-07-10 17:42:08 | ERROR | stderr |
23
- 2024-07-10 17:42:10 | ERROR | stderr |
24
- 2024-07-10 17:42:12 | ERROR | stderr |
25
- 2024-07-10 17:42:12 | ERROR | stderr |
26
- 2024-07-10 17:42:12 | ERROR | stderr |
27
- 2024-07-10 17:42:12 | INFO | model_worker | Register to controller
28
- 2024-07-10 17:42:12 | ERROR | stderr | INFO: Started server process [19648]
29
- 2024-07-10 17:42:12 | ERROR | stderr | INFO: Waiting for application startup.
30
- 2024-07-10 17:42:12 | ERROR | stderr | INFO: Application startup complete.
31
- 2024-07-10 17:42:12 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40006 (Press CTRL+C to quit)
32
- 2024-07-10 17:42:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
33
- 2024-07-10 17:42:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
34
- 2024-07-10 17:42:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
35
- 2024-07-10 17:43:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
36
- 2024-07-10 17:43:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
37
- 2024-07-10 17:43:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
38
- 2024-07-10 17:43:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
39
- 2024-07-10 17:44:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
40
- 2024-07-10 17:44:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
41
- 2024-07-10 17:44:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
42
- 2024-07-10 17:44:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
43
- 2024-07-10 17:45:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
44
- 2024-07-10 17:45:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
45
- 2024-07-10 17:45:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
46
- 2024-07-10 17:45:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
47
- 2024-07-10 17:46:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
48
- 2024-07-10 17:46:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
49
- 2024-07-10 17:46:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
50
- 2024-07-10 17:46:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
51
- 2024-07-10 17:47:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
52
- 2024-07-10 17:47:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
53
- 2024-07-10 17:47:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
54
- 2024-07-10 17:47:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
55
- 2024-07-10 17:48:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
56
- 2024-07-10 17:48:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
57
- 2024-07-10 17:48:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
58
- 2024-07-10 17:48:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
59
- 2024-07-10 17:49:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
60
- 2024-07-10 17:49:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
61
- 2024-07-10 17:49:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
62
- 2024-07-10 17:49:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
63
- 2024-07-10 17:50:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
64
- 2024-07-10 17:50:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
65
- 2024-07-10 17:50:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
66
- 2024-07-10 17:50:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
67
- 2024-07-10 17:51:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
68
- 2024-07-10 17:51:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
69
- 2024-07-10 17:51:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
70
- 2024-07-10 17:51:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
71
- 2024-07-10 17:52:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
72
- 2024-07-10 17:52:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
73
- 2024-07-10 17:52:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
74
- 2024-07-10 17:52:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
75
- 2024-07-10 17:53:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
76
- 2024-07-10 17:53:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
77
- 2024-07-10 17:53:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
78
- 2024-07-10 17:53:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
79
- 2024-07-10 17:54:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
80
- 2024-07-10 17:54:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
81
- 2024-07-10 17:54:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
82
- 2024-07-10 17:54:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
83
- 2024-07-10 17:55:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
84
- 2024-07-10 17:55:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
85
- 2024-07-10 17:55:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
86
- 2024-07-10 17:55:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
87
- 2024-07-10 17:56:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
88
- 2024-07-10 17:56:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
89
- 2024-07-10 17:56:33 | INFO | stdout | INFO: 10.140.60.209:47632 - "POST /worker_get_status HTTP/1.1" 200 OK
90
- 2024-07-10 17:56:36 | INFO | stdout | INFO: 10.140.60.209:47654 - "POST /worker_get_status HTTP/1.1" 200 OK
91
- 2024-07-10 17:56:37 | INFO | stdout | INFO: 10.140.60.209:47672 - "POST /worker_get_status HTTP/1.1" 200 OK
92
- 2024-07-10 17:56:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
93
- 2024-07-10 17:56:38 | INFO | stdout | INFO: 10.140.60.209:47678 - "POST /worker_generate_stream HTTP/1.1" 200 OK
94
- 2024-07-10 17:56:38 | INFO | stdout | history: []
95
- 2024-07-10 17:56:38 | INFO | stdout | question: Image-1: <image>
96
- 2024-07-10 17:56:38 | INFO | stdout | Describe this image in detail.
97
- 2024-07-10 17:56:38 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F2C1E90C400>]
98
- 2024-07-10 17:56:38 | INFO | model_worker | dynamic_image_size: True
99
- 2024-07-10 17:56:38 | INFO | model_worker | use_thumbnail: True
100
- 2024-07-10 17:56:38 | INFO | model_worker | Resize images to 448x448
101
- 2024-07-10 17:56:38 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
102
- 2024-07-10 17:56:39 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
103
- 2024-07-10 17:56:39 | ERROR | stderr | warnings.warn(
104
- 2024-07-10 17:56:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
105
- 2024-07-10 17:56:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
106
- 2024-07-10 17:57:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
107
- 2024-07-10 17:57:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
108
- 2024-07-10 17:57:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
109
- 2024-07-10 17:57:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
110
- 2024-07-10 17:58:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
111
- 2024-07-10 17:58:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_5f9311.log DELETED
@@ -1,268 +0,0 @@
1
- 2024-07-10 02:07:09 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 02:07:09 | INFO | model_worker | Loading the model InternVL2-1B on worker 5f9311 ...
3
- 2024-07-10 02:07:10 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 02:07:10 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 02:07:12 | INFO | model_worker | Register to controller
6
- 2024-07-10 02:07:13 | ERROR | stderr | INFO: Started server process [15195]
7
- 2024-07-10 02:07:13 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 02:07:13 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 02:07:13 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 02:07:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
11
- 2024-07-10 02:07:28 | INFO | stdout | INFO: 10.140.60.209:58970 - "POST /worker_get_status HTTP/1.1" 200 OK
12
- 2024-07-10 02:07:33 | INFO | stdout | INFO: 10.140.60.209:58972 - "POST /worker_get_status HTTP/1.1" 200 OK
13
- 2024-07-10 02:07:37 | INFO | stdout | INFO: 10.140.60.209:58974 - "POST /worker_get_status HTTP/1.1" 200 OK
14
- 2024-07-10 02:07:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
15
- 2024-07-10 02:07:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
16
- 2024-07-10 02:08:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
17
- 2024-07-10 02:08:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
18
- 2024-07-10 02:08:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
19
- 2024-07-10 02:08:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
20
- 2024-07-10 02:09:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
21
- 2024-07-10 02:09:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
22
- 2024-07-10 02:09:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
23
- 2024-07-10 02:09:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
24
- 2024-07-10 02:10:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
25
- 2024-07-10 02:10:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
26
- 2024-07-10 02:10:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
27
- 2024-07-10 02:10:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
28
- 2024-07-10 02:11:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
29
- 2024-07-10 02:11:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
30
- 2024-07-10 02:11:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
31
- 2024-07-10 02:11:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
32
- 2024-07-10 02:12:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
33
- 2024-07-10 02:12:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
34
- 2024-07-10 02:12:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
35
- 2024-07-10 02:12:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
36
- 2024-07-10 02:13:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
37
- 2024-07-10 02:13:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
38
- 2024-07-10 02:13:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
39
- 2024-07-10 02:13:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
40
- 2024-07-10 02:14:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
41
- 2024-07-10 02:14:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
42
- 2024-07-10 02:14:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
43
- 2024-07-10 02:14:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
44
- 2024-07-10 02:15:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
45
- 2024-07-10 02:15:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
46
- 2024-07-10 02:15:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
47
- 2024-07-10 02:15:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
48
- 2024-07-10 02:16:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
49
- 2024-07-10 02:16:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
50
- 2024-07-10 02:16:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
51
- 2024-07-10 02:16:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
52
- 2024-07-10 02:17:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
53
- 2024-07-10 02:17:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
54
- 2024-07-10 02:17:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
55
- 2024-07-10 02:17:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
56
- 2024-07-10 02:18:05 | INFO | stdout | INFO: 10.140.60.209:60518 - "POST /worker_get_status HTTP/1.1" 200 OK
57
- 2024-07-10 02:18:08 | INFO | stdout | INFO: 10.140.60.209:60526 - "POST /worker_get_status HTTP/1.1" 200 OK
58
- 2024-07-10 02:18:12 | INFO | stdout | INFO: 10.140.60.209:60554 - "POST /worker_get_status HTTP/1.1" 200 OK
59
- 2024-07-10 02:18:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
60
- 2024-07-10 02:18:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
61
- 2024-07-10 02:18:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
62
- 2024-07-10 02:18:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
63
- 2024-07-10 02:19:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
64
- 2024-07-10 02:19:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
65
- 2024-07-10 02:19:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
66
- 2024-07-10 02:19:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
67
- 2024-07-10 02:20:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
68
- 2024-07-10 02:20:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
69
- 2024-07-10 02:20:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
70
- 2024-07-10 02:20:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
71
- 2024-07-10 02:21:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
72
- 2024-07-10 02:21:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
73
- 2024-07-10 02:21:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
74
- 2024-07-10 02:21:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
75
- 2024-07-10 02:22:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
76
- 2024-07-10 02:22:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
77
- 2024-07-10 02:22:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
78
- 2024-07-10 02:22:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
79
- 2024-07-10 02:23:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
80
- 2024-07-10 02:23:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
81
- 2024-07-10 02:23:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
82
- 2024-07-10 02:23:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
83
- 2024-07-10 02:24:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
84
- 2024-07-10 02:24:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
85
- 2024-07-10 02:24:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
86
- 2024-07-10 02:24:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
87
- 2024-07-10 02:25:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
88
- 2024-07-10 02:25:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
89
- 2024-07-10 02:25:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
90
- 2024-07-10 02:25:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
91
- 2024-07-10 02:26:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
92
- 2024-07-10 02:26:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
93
- 2024-07-10 02:26:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
94
- 2024-07-10 02:26:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
95
- 2024-07-10 02:27:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
96
- 2024-07-10 02:27:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
97
- 2024-07-10 02:27:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
98
- 2024-07-10 02:27:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
99
- 2024-07-10 02:28:01 | INFO | stdout | INFO: 10.140.60.209:33828 - "POST /worker_get_status HTTP/1.1" 200 OK
100
- 2024-07-10 02:28:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
101
- 2024-07-10 02:28:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
102
- 2024-07-10 02:28:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
103
- 2024-07-10 02:28:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
104
- 2024-07-10 02:29:07 | INFO | stdout | INFO: 10.140.60.209:33986 - "POST /worker_get_status HTTP/1.1" 200 OK
105
- 2024-07-10 02:29:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
106
- 2024-07-10 02:29:14 | INFO | stdout | INFO: 10.140.60.209:34054 - "POST /worker_get_status HTTP/1.1" 200 OK
107
- 2024-07-10 02:29:17 | INFO | stdout | INFO: 10.140.60.209:34128 - "POST /worker_get_status HTTP/1.1" 200 OK
108
- 2024-07-10 02:29:17 | INFO | stdout | INFO: 10.140.60.209:34134 - "POST /worker_get_status HTTP/1.1" 200 OK
109
- 2024-07-10 02:29:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
110
- 2024-07-10 02:29:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
111
- 2024-07-10 02:29:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
112
- 2024-07-10 02:30:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
113
- 2024-07-10 02:30:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
114
- 2024-07-10 02:30:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
115
- 2024-07-10 02:30:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
116
- 2024-07-10 02:31:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
117
- 2024-07-10 02:31:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
118
- 2024-07-10 02:31:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
119
- 2024-07-10 02:31:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
120
- 2024-07-10 02:32:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
121
- 2024-07-10 02:32:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
122
- 2024-07-10 02:32:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
123
- 2024-07-10 02:32:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
124
- 2024-07-10 02:33:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
125
- 2024-07-10 02:33:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
126
- 2024-07-10 02:33:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
127
- 2024-07-10 02:33:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
128
- 2024-07-10 02:34:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
129
- 2024-07-10 02:34:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
130
- 2024-07-10 02:34:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
131
- 2024-07-10 02:34:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
132
- 2024-07-10 02:35:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
133
- 2024-07-10 02:35:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
134
- 2024-07-10 02:35:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
135
- 2024-07-10 02:35:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
136
- 2024-07-10 02:36:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
137
- 2024-07-10 02:36:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
138
- 2024-07-10 02:36:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
139
- 2024-07-10 02:36:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
140
- 2024-07-10 02:37:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
141
- 2024-07-10 02:37:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
142
- 2024-07-10 02:37:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
143
- 2024-07-10 02:37:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
144
- 2024-07-10 02:38:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
145
- 2024-07-10 02:38:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
146
- 2024-07-10 02:38:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
147
- 2024-07-10 02:38:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
148
- 2024-07-10 02:39:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
149
- 2024-07-10 02:39:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
150
- 2024-07-10 02:39:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
151
- 2024-07-10 02:40:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
152
- 2024-07-10 02:40:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
153
- 2024-07-10 02:40:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
154
- 2024-07-10 02:40:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
155
- 2024-07-10 02:41:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
156
- 2024-07-10 02:41:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
157
- 2024-07-10 02:41:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
158
- 2024-07-10 02:41:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
159
- 2024-07-10 02:42:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
160
- 2024-07-10 02:42:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
161
- 2024-07-10 02:42:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
162
- 2024-07-10 02:42:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
163
- 2024-07-10 02:43:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
164
- 2024-07-10 02:43:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
165
- 2024-07-10 02:43:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
166
- 2024-07-10 02:43:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
167
- 2024-07-10 02:44:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
168
- 2024-07-10 02:44:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
169
- 2024-07-10 02:44:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
170
- 2024-07-10 02:44:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
171
- 2024-07-10 02:45:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
172
- 2024-07-10 02:45:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
173
- 2024-07-10 02:45:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
174
- 2024-07-10 02:45:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
175
- 2024-07-10 02:46:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
176
- 2024-07-10 02:46:01 | INFO | stdout | INFO: 10.140.60.209:36508 - "POST /worker_get_status HTTP/1.1" 200 OK
177
- 2024-07-10 02:46:02 | INFO | stdout | INFO: 10.140.60.209:36510 - "POST /worker_get_status HTTP/1.1" 200 OK
178
- 2024-07-10 02:46:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
179
- 2024-07-10 02:46:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
180
- 2024-07-10 02:46:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
181
- 2024-07-10 02:47:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
182
- 2024-07-10 02:47:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
183
- 2024-07-10 02:47:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
184
- 2024-07-10 02:47:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
185
- 2024-07-10 02:48:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
186
- 2024-07-10 02:48:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
187
- 2024-07-10 02:48:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
188
- 2024-07-10 02:48:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
189
- 2024-07-10 02:49:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
190
- 2024-07-10 02:49:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
191
- 2024-07-10 02:49:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
192
- 2024-07-10 02:49:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
193
- 2024-07-10 02:50:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
194
- 2024-07-10 02:50:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
195
- 2024-07-10 02:50:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
196
- 2024-07-10 02:50:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
197
- 2024-07-10 02:51:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
198
- 2024-07-10 02:51:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
199
- 2024-07-10 02:51:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
200
- 2024-07-10 02:51:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
201
- 2024-07-10 02:52:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
202
- 2024-07-10 02:52:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
203
- 2024-07-10 02:52:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
204
- 2024-07-10 02:52:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
205
- 2024-07-10 02:53:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
206
- 2024-07-10 02:53:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
207
- 2024-07-10 02:53:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
208
- 2024-07-10 02:53:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
209
- 2024-07-10 02:54:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
210
- 2024-07-10 02:54:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
211
- 2024-07-10 02:54:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
212
- 2024-07-10 02:54:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
213
- 2024-07-10 02:55:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
214
- 2024-07-10 02:55:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
215
- 2024-07-10 02:55:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
216
- 2024-07-10 02:55:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
217
- 2024-07-10 02:56:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
218
- 2024-07-10 02:56:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
219
- 2024-07-10 02:56:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
220
- 2024-07-10 02:56:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
221
- 2024-07-10 02:57:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
222
- 2024-07-10 02:57:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
223
- 2024-07-10 02:57:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
224
- 2024-07-10 02:57:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
225
- 2024-07-10 02:58:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
226
- 2024-07-10 02:58:11 | INFO | stdout | INFO: 10.140.60.209:38250 - "POST /worker_get_status HTTP/1.1" 200 OK
227
- 2024-07-10 02:58:13 | INFO | stdout | INFO: 10.140.60.209:38292 - "POST /worker_get_status HTTP/1.1" 200 OK
228
- 2024-07-10 02:58:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
229
- 2024-07-10 02:58:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
230
- 2024-07-10 02:58:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
231
- 2024-07-10 02:59:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
232
- 2024-07-10 02:59:01 | INFO | stdout | INFO: 10.140.60.209:38394 - "POST /worker_get_status HTTP/1.1" 200 OK
233
- 2024-07-10 02:59:03 | INFO | stdout | INFO: 10.140.60.209:38396 - "POST /worker_get_status HTTP/1.1" 200 OK
234
- 2024-07-10 02:59:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
235
- 2024-07-10 02:59:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
236
- 2024-07-10 02:59:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
237
- 2024-07-10 03:00:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
238
- 2024-07-10 03:00:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
239
- 2024-07-10 03:00:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
240
- 2024-07-10 03:00:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
241
- 2024-07-10 03:01:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
242
- 2024-07-10 03:01:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
243
- 2024-07-10 03:01:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
244
- 2024-07-10 03:01:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
245
- 2024-07-10 03:02:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
246
- 2024-07-10 03:02:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
247
- 2024-07-10 03:02:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
248
- 2024-07-10 03:02:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
249
- 2024-07-10 03:03:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
250
- 2024-07-10 03:03:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
251
- 2024-07-10 03:03:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
252
- 2024-07-10 03:03:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
253
- 2024-07-10 03:04:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
254
- 2024-07-10 03:04:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
255
- 2024-07-10 03:04:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
256
- 2024-07-10 03:04:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
257
- 2024-07-10 03:05:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
258
- 2024-07-10 03:05:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
259
- 2024-07-10 03:05:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
260
- 2024-07-10 03:05:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
261
- 2024-07-10 03:06:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
262
- 2024-07-10 03:06:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
263
- 2024-07-10 03:06:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
264
- 2024-07-10 03:06:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
265
- 2024-07-10 03:07:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
266
- 2024-07-10 03:07:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
267
- 2024-07-10 03:07:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
268
- 2024-07-10 03:07:39 | ERROR | stderr | INFO: Shutting down
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_6223f6.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_6223f6.log.2024-07-10 DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_6a86a0.log DELETED
@@ -1,79 +0,0 @@
1
- 2024-07-11 22:35:44 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40008, worker_address='http://10.140.60.182:40008', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-Pro/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:35:44 | INFO | model_worker | Loading the model InternVL2-Pro on worker 6a86a0 ...
3
- 2024-07-11 22:35:44 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:35:44 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:35:48 | ERROR | stderr |
6
- 2024-07-11 22:35:50 | ERROR | stderr |
7
- 2024-07-11 22:35:53 | ERROR | stderr |
8
- 2024-07-11 22:35:55 | ERROR | stderr |
9
- 2024-07-11 22:35:57 | ERROR | stderr |
10
- 2024-07-11 22:35:59 | ERROR | stderr |
11
- 2024-07-11 22:36:01 | ERROR | stderr |
12
- 2024-07-11 22:36:03 | ERROR | stderr |
13
- 2024-07-11 22:36:06 | ERROR | stderr |
14
- 2024-07-11 22:36:08 | ERROR | stderr |
15
- 2024-07-11 22:36:10 | ERROR | stderr |
16
- 2024-07-11 22:36:12 | ERROR | stderr |
17
- 2024-07-11 22:36:14 | ERROR | stderr |
18
- 2024-07-11 22:36:16 | ERROR | stderr |
19
- 2024-07-11 22:36:18 | ERROR | stderr |
20
- 2024-07-11 22:36:20 | ERROR | stderr |
21
- 2024-07-11 22:36:22 | ERROR | stderr |
22
- 2024-07-11 22:36:24 | ERROR | stderr |
23
- 2024-07-11 22:36:26 | ERROR | stderr |
24
- 2024-07-11 22:36:28 | ERROR | stderr |
25
- 2024-07-11 22:36:30 | ERROR | stderr |
26
- 2024-07-11 22:36:32 | ERROR | stderr |
27
- 2024-07-11 22:36:34 | ERROR | stderr |
28
- 2024-07-11 22:36:36 | ERROR | stderr |
29
- 2024-07-11 22:36:38 | ERROR | stderr |
30
- 2024-07-11 22:36:40 | ERROR | stderr |
31
- 2024-07-11 22:36:42 | ERROR | stderr |
32
- 2024-07-11 22:36:44 | ERROR | stderr |
33
- 2024-07-11 22:36:46 | ERROR | stderr |
34
- 2024-07-11 22:36:48 | ERROR | stderr |
35
- 2024-07-11 22:36:50 | ERROR | stderr |
36
- 2024-07-11 22:36:52 | ERROR | stderr |
37
- 2024-07-11 22:36:54 | ERROR | stderr |
38
- 2024-07-11 22:36:55 | ERROR | stderr |
39
- 2024-07-11 22:36:55 | ERROR | stderr |
40
- 2024-07-11 22:36:55 | ERROR | stderr |
41
- 2024-07-11 22:36:56 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:36:56 | ERROR | stderr | INFO: Started server process [20613]
43
- 2024-07-11 22:36:56 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:36:56 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:36:56 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40008 (Press CTRL+C to quit)
46
- 2024-07-11 22:36:57 | INFO | stdout | INFO: 10.140.60.209:47186 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:47210 - "POST /worker_get_status HTTP/1.1" 200 OK
48
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:47230 - "POST /worker_get_status HTTP/1.1" 200 OK
49
- 2024-07-11 22:37:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
50
- 2024-07-11 22:37:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
51
- 2024-07-11 22:37:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:37:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
53
- 2024-07-11 22:38:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
54
- 2024-07-11 22:38:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:38:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
56
- 2024-07-11 22:38:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:39:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
58
- 2024-07-11 22:39:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
59
- 2024-07-11 22:39:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
60
- 2024-07-11 22:39:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:40:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
62
- 2024-07-11 22:40:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
63
- 2024-07-11 22:40:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:40:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:49092 - "POST /worker_get_status HTTP/1.1" 200 OK
66
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:49112 - "POST /worker_get_status HTTP/1.1" 200 OK
67
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:49132 - "POST /worker_get_status HTTP/1.1" 200 OK
68
- 2024-07-11 22:41:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:41:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:41:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
71
- 2024-07-11 22:41:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
72
- 2024-07-11 22:42:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
73
- 2024-07-11 22:42:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
74
- 2024-07-11 22:42:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
75
- 2024-07-11 22:42:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
76
- 2024-07-11 22:43:07 | INFO | stdout | INFO: 10.140.60.209:49790 - "POST /worker_get_status HTTP/1.1" 200 OK
77
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:49810 - "POST /worker_get_status HTTP/1.1" 200 OK
78
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:49830 - "POST /worker_get_status HTTP/1.1" 200 OK
79
- 2024-07-11 22:43:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_6ed459.log DELETED
@@ -1,402 +0,0 @@
1
- 2024-07-10 18:23:55 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40008, worker_address='http://10.140.60.182:40008', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-Pro/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 18:23:55 | INFO | model_worker | Loading the model InternVL2-Pro on worker 6ed459 ...
3
- 2024-07-10 18:23:55 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 18:23:55 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 18:24:03 | ERROR | stderr |
6
- 2024-07-10 18:24:05 | ERROR | stderr |
7
- 2024-07-10 18:24:07 | ERROR | stderr |
8
- 2024-07-10 18:24:09 | ERROR | stderr |
9
- 2024-07-10 18:24:11 | ERROR | stderr |
10
- 2024-07-10 18:24:13 | ERROR | stderr |
11
- 2024-07-10 18:24:16 | ERROR | stderr |
12
- 2024-07-10 18:24:18 | ERROR | stderr |
13
- 2024-07-10 18:24:20 | ERROR | stderr |
14
- 2024-07-10 18:24:22 | ERROR | stderr |
15
- 2024-07-10 18:24:24 | ERROR | stderr |
16
- 2024-07-10 18:24:26 | ERROR | stderr |
17
- 2024-07-10 18:24:28 | ERROR | stderr |
18
- 2024-07-10 18:24:30 | ERROR | stderr |
19
- 2024-07-10 18:24:32 | ERROR | stderr |
20
- 2024-07-10 18:24:34 | ERROR | stderr |
21
- 2024-07-10 18:24:36 | ERROR | stderr |
22
- 2024-07-10 18:24:39 | ERROR | stderr |
23
- 2024-07-10 18:24:41 | ERROR | stderr |
24
- 2024-07-10 18:24:43 | ERROR | stderr |
25
- 2024-07-10 18:24:45 | ERROR | stderr |
26
- 2024-07-10 18:24:47 | ERROR | stderr |
27
- 2024-07-10 18:24:49 | ERROR | stderr |
28
- 2024-07-10 18:24:51 | ERROR | stderr |
29
- 2024-07-10 18:24:53 | ERROR | stderr |
30
- 2024-07-10 18:24:55 | ERROR | stderr |
31
- 2024-07-10 18:24:57 | ERROR | stderr |
32
- 2024-07-10 18:24:59 | ERROR | stderr |
33
- 2024-07-10 18:25:01 | ERROR | stderr |
34
- 2024-07-10 18:25:03 | ERROR | stderr |
35
- 2024-07-10 18:25:05 | ERROR | stderr |
36
- 2024-07-10 18:25:07 | ERROR | stderr |
37
- 2024-07-10 18:25:09 | ERROR | stderr |
38
- 2024-07-10 18:25:10 | ERROR | stderr |
39
- 2024-07-10 18:25:10 | ERROR | stderr |
40
- 2024-07-10 18:25:10 | ERROR | stderr |
41
- 2024-07-10 18:25:11 | INFO | model_worker | Register to controller
42
- 2024-07-10 18:25:11 | ERROR | stderr | INFO: Started server process [14778]
43
- 2024-07-10 18:25:11 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-10 18:25:11 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-10 18:25:11 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40008 (Press CTRL+C to quit)
46
- 2024-07-10 18:25:18 | INFO | stdout | INFO: 10.140.60.209:50882 - "POST /worker_get_status HTTP/1.1" 200 OK
47
- 2024-07-10 18:25:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
48
- 2024-07-10 18:25:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
49
- 2024-07-10 18:25:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
50
- 2024-07-10 18:26:08 | INFO | stdout | INFO: 10.140.60.209:50960 - "POST /worker_get_status HTTP/1.1" 200 OK
51
- 2024-07-10 18:26:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
52
- 2024-07-10 18:26:16 | INFO | stdout | INFO: 10.140.60.209:51084 - "POST /worker_get_status HTTP/1.1" 200 OK
53
- 2024-07-10 18:26:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
54
- 2024-07-10 18:26:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
55
- 2024-07-10 18:26:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
56
- 2024-07-10 18:27:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
57
- 2024-07-10 18:27:18 | INFO | stdout | INFO: 10.140.60.209:51352 - "POST /worker_get_status HTTP/1.1" 200 OK
58
- 2024-07-10 18:27:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
59
- 2024-07-10 18:27:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
60
- 2024-07-10 18:27:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
61
- 2024-07-10 18:28:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
62
- 2024-07-10 18:28:25 | INFO | stdout | INFO: 10.140.60.209:51600 - "POST /worker_get_status HTTP/1.1" 200 OK
63
- 2024-07-10 18:28:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
64
- 2024-07-10 18:28:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
65
- 2024-07-10 18:28:56 | INFO | stdout | INFO: 10.140.60.209:51640 - "POST /worker_get_status HTTP/1.1" 200 OK
66
- 2024-07-10 18:28:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
67
- 2024-07-10 18:29:05 | INFO | stdout | INFO: 10.140.60.209:51666 - "POST /worker_get_status HTTP/1.1" 200 OK
68
- 2024-07-10 18:29:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
69
- 2024-07-10 18:29:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
70
- 2024-07-10 18:29:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
71
- 2024-07-10 18:29:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
72
- 2024-07-10 18:30:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
73
- 2024-07-10 18:30:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
74
- 2024-07-10 18:30:34 | INFO | stdout | INFO: 10.140.60.209:52062 - "POST /worker_get_status HTTP/1.1" 200 OK
75
- 2024-07-10 18:30:40 | INFO | stdout | INFO: 10.140.60.209:52084 - "POST /worker_get_status HTTP/1.1" 200 OK
76
- 2024-07-10 18:30:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
77
- 2024-07-10 18:30:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
78
- 2024-07-10 18:31:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
79
- 2024-07-10 18:31:23 | INFO | stdout | INFO: 10.140.60.209:52274 - "POST /worker_get_status HTTP/1.1" 200 OK
80
- 2024-07-10 18:31:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
81
- 2024-07-10 18:31:31 | INFO | stdout | INFO: 10.140.60.209:52294 - "POST /worker_get_status HTTP/1.1" 200 OK
82
- 2024-07-10 18:31:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
83
- 2024-07-10 18:31:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
84
- 2024-07-10 18:32:02 | INFO | stdout | INFO: 10.140.60.209:52342 - "POST /worker_get_status HTTP/1.1" 200 OK
85
- 2024-07-10 18:32:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
86
- 2024-07-10 18:32:12 | INFO | stdout | INFO: 10.140.60.209:52372 - "POST /worker_get_status HTTP/1.1" 200 OK
87
- 2024-07-10 18:32:19 | INFO | stdout | INFO: 10.140.60.209:52552 - "POST /worker_get_status HTTP/1.1" 200 OK
88
- 2024-07-10 18:32:22 | INFO | stdout | INFO: 10.140.60.209:52574 - "POST /worker_get_status HTTP/1.1" 200 OK
89
- 2024-07-10 18:32:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
90
- 2024-07-10 18:32:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
91
- 2024-07-10 18:32:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
92
- 2024-07-10 18:33:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
93
- 2024-07-10 18:33:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
94
- 2024-07-10 18:33:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
95
- 2024-07-10 18:33:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
96
- 2024-07-10 18:34:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
97
- 2024-07-10 18:34:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
98
- 2024-07-10 18:34:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
99
- 2024-07-10 18:34:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
100
- 2024-07-10 18:35:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
101
- 2024-07-10 18:35:17 | INFO | stdout | INFO: 10.140.60.209:53134 - "POST /worker_get_status HTTP/1.1" 200 OK
102
- 2024-07-10 18:35:25 | INFO | stdout | INFO: 10.140.60.209:53186 - "POST /worker_get_status HTTP/1.1" 200 OK
103
- 2024-07-10 18:35:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
104
- 2024-07-10 18:35:26 | INFO | stdout | INFO: 10.140.60.209:53192 - "POST /worker_generate_stream HTTP/1.1" 200 OK
105
- 2024-07-10 18:35:26 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image depicts a close-up of a man dressed in what appears to be Viking or Norse warrior attire. He has a fierce and determined expression on his face, with piercing blue eyes that seem to stare directly at the viewer. His thick, reddish-brown beard and mustache are well-groomed, adding to his imposing and rugged appearance.\n\nThe man is wearing a helmet with two large, curved horns on top, reminiscent of traditional Viking helmets. The helmet is adorned with metal rivets and has a leather strap that encircles his head, providing a secure fit. The helmet's design suggests it is meant for battle, offering protection while also serving as a symbol of his warrior status.\n\nHis attire includes a fur-lined cloak or cape, which adds to the overall impression of his readiness for harsh, cold climates. The fur appears soft and thick, likely providing warmth and comfort in cold weather. The cloak is draped over his shoulders and is secured by a leather strap or clasp, ensuring it stays in place during movement.\n\nThe man's skin is fair, and his facial features are strong and defined, with high cheekbones and a prominent jawline. His expression is intense and focused, suggesting he is a seasoned warrior or leader.\n\nThe background of the image is blurred, drawing the viewer's attention to the man's face and attire. The lighting is dramatic, with shadows accentuating the contours of his face and the texture of his beard and fur cloak. The overall mood of the image is one of strength, determination, and readiness for battle. "]]
106
- 2024-07-10 18:35:26 | INFO | stdout | question: Pretrain Speech Encoder啥意思
107
- 2024-07-10 18:35:26 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F598C93BB50>]
108
- 2024-07-10 18:35:26 | INFO | model_worker | dynamic_image_size: True
109
- 2024-07-10 18:35:26 | INFO | model_worker | use_thumbnail: True
110
- 2024-07-10 18:35:26 | INFO | model_worker | Resize images to 448x448
111
- 2024-07-10 18:35:26 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
112
- 2024-07-10 18:35:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
113
- 2024-07-10 18:35:27 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
114
- 2024-07-10 18:35:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
115
- 2024-07-10 18:35:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
116
- 2024-07-10 18:36:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
117
- 2024-07-10 18:36:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
118
- 2024-07-10 18:36:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
119
- 2024-07-10 18:36:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
120
- 2024-07-10 18:36:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
121
- 2024-07-10 18:37:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
122
- 2024-07-10 18:37:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
123
- 2024-07-10 18:37:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
124
- 2024-07-10 18:37:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
125
- 2024-07-10 18:38:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
126
- 2024-07-10 18:38:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
127
- 2024-07-10 18:38:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
128
- 2024-07-10 18:38:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
129
- 2024-07-10 18:39:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
130
- 2024-07-10 18:39:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
131
- 2024-07-10 18:39:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
132
- 2024-07-10 18:39:57 | INFO | stdout | INFO: 10.140.60.209:53982 - "POST /worker_get_status HTTP/1.1" 200 OK
133
- 2024-07-10 18:39:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
134
- 2024-07-10 18:40:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
135
- 2024-07-10 18:40:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
136
- 2024-07-10 18:40:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
137
- 2024-07-10 18:40:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
138
- 2024-07-10 18:40:59 | INFO | stdout | INFO: 10.140.60.209:54238 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-10 18:41:02 | INFO | stdout | INFO: 10.140.60.209:54258 - "POST /worker_get_status HTTP/1.1" 200 OK
140
- 2024-07-10 18:41:03 | INFO | stdout | INFO: 10.140.60.209:54282 - "POST /worker_get_status HTTP/1.1" 200 OK
141
- 2024-07-10 18:41:04 | INFO | stdout | INFO: 10.140.60.209:54302 - "POST /worker_get_status HTTP/1.1" 200 OK
142
- 2024-07-10 18:41:06 | INFO | stdout | INFO: 10.140.60.209:54322 - "POST /worker_get_status HTTP/1.1" 200 OK
143
- 2024-07-10 18:41:08 | INFO | stdout | INFO: 10.140.60.209:54344 - "POST /worker_get_status HTTP/1.1" 200 OK
144
- 2024-07-10 18:41:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
145
- 2024-07-10 18:41:13 | INFO | stdout | INFO: 10.140.60.209:54408 - "POST /worker_get_status HTTP/1.1" 200 OK
146
- 2024-07-10 18:41:14 | INFO | stdout | INFO: 10.140.60.209:54442 - "POST /worker_get_status HTTP/1.1" 200 OK
147
- 2024-07-10 18:41:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
148
- 2024-07-10 18:41:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
149
- 2024-07-10 18:41:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
150
- 2024-07-10 18:42:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
151
- 2024-07-10 18:42:15 | INFO | stdout | INFO: 10.140.60.209:54692 - "POST /worker_get_status HTTP/1.1" 200 OK
152
- 2024-07-10 18:42:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
153
- 2024-07-10 18:42:30 | INFO | stdout | INFO: 10.140.60.209:54796 - "POST /worker_get_status HTTP/1.1" 200 OK
154
- 2024-07-10 18:42:38 | INFO | stdout | INFO: 10.140.60.209:54824 - "POST /worker_get_status HTTP/1.1" 200 OK
155
- 2024-07-10 18:42:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
156
- 2024-07-10 18:42:48 | INFO | stdout | INFO: 10.140.60.209:54860 - "POST /worker_get_status HTTP/1.1" 200 OK
157
- 2024-07-10 18:42:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
158
- 2024-07-10 18:42:58 | INFO | stdout | INFO: 10.140.60.209:54888 - "POST /worker_get_status HTTP/1.1" 200 OK
159
- 2024-07-10 18:43:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
160
- 2024-07-10 18:43:24 | INFO | stdout | INFO: 10.140.60.209:55076 - "POST /worker_get_status HTTP/1.1" 200 OK
161
- 2024-07-10 18:43:25 | INFO | stdout | INFO: 10.140.60.209:55096 - "POST /worker_get_status HTTP/1.1" 200 OK
162
- 2024-07-10 18:43:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
163
- 2024-07-10 18:43:30 | INFO | stdout | INFO: 10.140.60.209:55118 - "POST /worker_get_status HTTP/1.1" 200 OK
164
- 2024-07-10 18:43:34 | INFO | stdout | INFO: 10.140.60.209:55138 - "POST /worker_get_status HTTP/1.1" 200 OK
165
- 2024-07-10 18:43:35 | INFO | stdout | INFO: 10.140.60.209:55158 - "POST /worker_get_status HTTP/1.1" 200 OK
166
- 2024-07-10 18:43:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
167
- 2024-07-10 18:43:36 | INFO | stdout | INFO: 10.140.60.209:55164 - "POST /worker_generate_stream HTTP/1.1" 200 OK
168
- 2024-07-10 18:43:36 | INFO | stdout | history: []
169
- 2024-07-10 18:43:36 | INFO | stdout | question: Image-1: <image>
170
- 2024-07-10 18:43:36 | INFO | stdout | Describe this image in detail.
171
- 2024-07-10 18:43:36 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F59657D5840>]
172
- 2024-07-10 18:43:36 | INFO | model_worker | dynamic_image_size: True
173
- 2024-07-10 18:43:36 | INFO | model_worker | use_thumbnail: True
174
- 2024-07-10 18:43:36 | INFO | model_worker | Resize images to 448x448
175
- 2024-07-10 18:43:36 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
176
- 2024-07-10 18:43:37 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
177
- 2024-07-10 18:43:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
178
- 2024-07-10 18:43:57 | INFO | stdout | INFO: 10.140.60.209:55194 - "POST /worker_get_status HTTP/1.1" 200 OK
179
- 2024-07-10 18:43:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
180
- 2024-07-10 18:44:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
181
- 2024-07-10 18:44:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
182
- 2024-07-10 18:44:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
183
- 2024-07-10 18:44:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
184
- 2024-07-10 18:44:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
185
- 2024-07-10 18:45:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
186
- 2024-07-10 18:45:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
187
- 2024-07-10 18:45:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
188
- 2024-07-10 18:45:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
189
- 2024-07-10 18:46:02 | INFO | stdout | INFO: 10.140.60.209:55616 - "POST /worker_get_status HTTP/1.1" 200 OK
190
- 2024-07-10 18:46:03 | INFO | stdout | INFO: 10.140.60.209:55636 - "POST /worker_get_status HTTP/1.1" 200 OK
191
- 2024-07-10 18:46:07 | INFO | stdout | INFO: 10.140.60.209:55656 - "POST /worker_get_status HTTP/1.1" 200 OK
192
- 2024-07-10 18:46:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
193
- 2024-07-10 18:46:21 | INFO | stdout | INFO: 10.140.60.209:55848 - "POST /worker_get_status HTTP/1.1" 200 OK
194
- 2024-07-10 18:46:22 | INFO | stdout | INFO: 10.140.60.209:55868 - "POST /worker_get_status HTTP/1.1" 200 OK
195
- 2024-07-10 18:46:23 | INFO | stdout | INFO: 10.140.60.209:55888 - "POST /worker_get_status HTTP/1.1" 200 OK
196
- 2024-07-10 18:46:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
197
- 2024-07-10 18:46:28 | INFO | stdout | INFO: 10.140.60.209:55918 - "POST /worker_get_status HTTP/1.1" 200 OK
198
- 2024-07-10 18:46:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
199
- 2024-07-10 18:46:44 | INFO | stdout | INFO: 10.140.60.209:56018 - "POST /worker_get_status HTTP/1.1" 200 OK
200
- 2024-07-10 18:46:56 | INFO | stdout | INFO: 10.140.60.209:56062 - "POST /worker_get_status HTTP/1.1" 200 OK
201
- 2024-07-10 18:46:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
202
- 2024-07-10 18:46:59 | INFO | stdout | INFO: 10.140.60.209:56086 - "POST /worker_get_status HTTP/1.1" 200 OK
203
- 2024-07-10 18:46:59 | INFO | stdout | INFO: 10.140.60.209:56106 - "POST /worker_get_status HTTP/1.1" 200 OK
204
- 2024-07-10 18:47:09 | INFO | stdout | INFO: 10.140.60.209:56132 - "POST /worker_get_status HTTP/1.1" 200 OK
205
- 2024-07-10 18:47:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
206
- 2024-07-10 18:47:14 | INFO | stdout | INFO: 10.140.60.209:56222 - "POST /worker_get_status HTTP/1.1" 200 OK
207
- 2024-07-10 18:47:21 | INFO | stdout | INFO: 10.140.60.209:56374 - "POST /worker_get_status HTTP/1.1" 200 OK
208
- 2024-07-10 18:47:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
209
- 2024-07-10 18:47:29 | INFO | stdout | INFO: 10.140.60.209:56410 - "POST /worker_get_status HTTP/1.1" 200 OK
210
- 2024-07-10 18:47:32 | INFO | stdout | INFO: 10.140.60.209:56448 - "POST /worker_get_status HTTP/1.1" 200 OK
211
- 2024-07-10 18:47:35 | INFO | stdout | INFO: 10.140.60.209:56468 - "POST /worker_get_status HTTP/1.1" 200 OK
212
- 2024-07-10 18:47:35 | INFO | stdout | INFO: 10.140.60.209:56488 - "POST /worker_get_status HTTP/1.1" 200 OK
213
- 2024-07-10 18:47:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
214
- 2024-07-10 18:47:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
215
- 2024-07-10 18:48:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
216
- 2024-07-10 18:48:15 | INFO | stdout | INFO: 10.140.60.209:56674 - "POST /worker_get_status HTTP/1.1" 200 OK
217
- 2024-07-10 18:48:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
218
- 2024-07-10 18:48:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
219
- 2024-07-10 18:48:47 | INFO | stdout | INFO: 10.140.60.209:56808 - "POST /worker_get_status HTTP/1.1" 200 OK
220
- 2024-07-10 18:48:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
221
- 2024-07-10 18:49:12 | INFO | stdout | INFO: 10.140.60.209:56864 - "POST /worker_get_status HTTP/1.1" 200 OK
222
- 2024-07-10 18:49:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
223
- 2024-07-10 18:49:16 | INFO | stdout | INFO: 10.140.60.209:56974 - "POST /worker_get_status HTTP/1.1" 200 OK
224
- 2024-07-10 18:49:25 | INFO | stdout | INFO: 10.140.60.209:57057 - "POST /worker_get_status HTTP/1.1" 200 OK
225
- 2024-07-10 18:49:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
226
- 2024-07-10 18:49:36 | INFO | stdout | INFO: 10.140.60.209:57084 - "POST /worker_get_status HTTP/1.1" 200 OK
227
- 2024-07-10 18:49:36 | INFO | stdout | INFO: 10.140.60.209:57104 - "POST /worker_get_status HTTP/1.1" 200 OK
228
- 2024-07-10 18:49:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
229
- 2024-07-10 18:49:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
230
- 2024-07-10 18:50:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
231
- 2024-07-10 18:50:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
232
- 2024-07-10 18:50:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
233
- 2024-07-10 18:50:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
234
- 2024-07-10 18:51:06 | INFO | stdout | INFO: 10.140.60.209:57340 - "POST /worker_get_status HTTP/1.1" 200 OK
235
- 2024-07-10 18:51:09 | INFO | stdout | INFO: 10.140.60.209:57362 - "POST /worker_get_status HTTP/1.1" 200 OK
236
- 2024-07-10 18:51:10 | INFO | stdout | INFO: 10.140.60.209:57382 - "POST /worker_get_status HTTP/1.1" 200 OK
237
- 2024-07-10 18:51:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
238
- 2024-07-10 18:51:13 | INFO | stdout | INFO: 10.140.60.209:57434 - "POST /worker_get_status HTTP/1.1" 200 OK
239
- 2024-07-10 18:51:14 | INFO | stdout | INFO: 10.140.60.209:57476 - "POST /worker_get_status HTTP/1.1" 200 OK
240
- 2024-07-10 18:51:15 | INFO | stdout | INFO: 10.140.60.209:57524 - "POST /worker_get_status HTTP/1.1" 200 OK
241
- 2024-07-10 18:51:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
242
- 2024-07-10 18:51:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
243
- 2024-07-10 18:51:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
244
- 2024-07-10 18:52:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
245
- 2024-07-10 18:52:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
246
- 2024-07-10 18:52:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
247
- 2024-07-10 18:52:45 | INFO | stdout | INFO: 10.140.60.209:58028 - "POST /worker_get_status HTTP/1.1" 200 OK
248
- 2024-07-10 18:52:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
249
- 2024-07-10 18:53:08 | INFO | stdout | INFO: 10.140.60.209:58062 - "POST /worker_get_status HTTP/1.1" 200 OK
250
- 2024-07-10 18:53:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
251
- 2024-07-10 18:53:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
252
- 2024-07-10 18:53:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
253
- 2024-07-10 18:53:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
254
- 2024-07-10 18:54:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
255
- 2024-07-10 18:54:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
256
- 2024-07-10 18:54:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
257
- 2024-07-10 18:54:54 | INFO | stdout | INFO: 10.140.60.209:58638 - "POST /worker_get_status HTTP/1.1" 200 OK
258
- 2024-07-10 18:54:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
259
- 2024-07-10 18:55:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
260
- 2024-07-10 18:55:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
261
- 2024-07-10 18:55:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
262
- 2024-07-10 18:55:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
263
- 2024-07-10 18:56:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
264
- 2024-07-10 18:56:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
265
- 2024-07-10 18:56:38 | INFO | stdout | INFO: 10.140.60.209:59154 - "POST /worker_get_status HTTP/1.1" 200 OK
266
- 2024-07-10 18:56:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
267
- 2024-07-10 18:56:56 | INFO | stdout | INFO: 10.140.60.209:59178 - "POST /worker_get_status HTTP/1.1" 200 OK
268
- 2024-07-10 18:56:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
269
- 2024-07-10 18:57:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
270
- 2024-07-10 18:57:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
271
- 2024-07-10 18:57:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
272
- 2024-07-10 18:57:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
273
- 2024-07-10 18:58:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
274
- 2024-07-10 18:58:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
275
- 2024-07-10 18:58:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
276
- 2024-07-10 18:58:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
277
- 2024-07-10 18:59:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
278
- 2024-07-10 18:59:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
279
- 2024-07-10 18:59:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
280
- 2024-07-10 18:59:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
281
- 2024-07-10 19:00:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
282
- 2024-07-10 19:00:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
283
- 2024-07-10 19:00:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
284
- 2024-07-10 19:00:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
285
- 2024-07-10 19:01:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
286
- 2024-07-10 19:01:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
287
- 2024-07-10 19:01:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
288
- 2024-07-10 19:01:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
289
- 2024-07-10 19:02:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
290
- 2024-07-10 19:02:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
291
- 2024-07-10 19:02:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
292
- 2024-07-10 19:02:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
293
- 2024-07-10 19:03:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
294
- 2024-07-10 19:03:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
295
- 2024-07-10 19:03:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
296
- 2024-07-10 19:03:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
297
- 2024-07-10 19:04:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
298
- 2024-07-10 19:04:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
299
- 2024-07-10 19:04:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
300
- 2024-07-10 19:04:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
301
- 2024-07-10 19:05:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
302
- 2024-07-10 19:05:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
303
- 2024-07-10 19:05:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
304
- 2024-07-10 19:05:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
305
- 2024-07-10 19:06:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
306
- 2024-07-10 19:06:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
307
- 2024-07-10 19:06:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
308
- 2024-07-10 19:06:51 | INFO | stdout | INFO: 10.140.60.209:33692 - "POST /worker_get_status HTTP/1.1" 200 OK
309
- 2024-07-10 19:06:56 | INFO | stdout | INFO: 10.140.60.209:33712 - "POST /worker_get_status HTTP/1.1" 200 OK
310
- 2024-07-10 19:06:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
311
- 2024-07-10 19:07:03 | INFO | stdout | INFO: 10.140.60.209:33748 - "POST /worker_get_status HTTP/1.1" 200 OK
312
- 2024-07-10 19:07:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
313
- 2024-07-10 19:07:14 | INFO | stdout | INFO: 10.140.60.209:33854 - "POST /worker_get_status HTTP/1.1" 200 OK
314
- 2024-07-10 19:07:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
315
- 2024-07-10 19:07:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
316
- 2024-07-10 19:07:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
317
- 2024-07-10 19:08:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
318
- 2024-07-10 19:08:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
319
- 2024-07-10 19:08:40 | INFO | stdout | INFO: 10.140.60.209:34340 - "POST /worker_get_status HTTP/1.1" 200 OK
320
- 2024-07-10 19:08:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
321
- 2024-07-10 19:08:44 | INFO | stdout | INFO: 10.140.60.209:34372 - "POST /worker_get_status HTTP/1.1" 200 OK
322
- 2024-07-10 19:08:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
323
- 2024-07-10 19:09:05 | INFO | stdout | INFO: 10.140.60.209:34478 - "POST /worker_get_status HTTP/1.1" 200 OK
324
- 2024-07-10 19:09:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
325
- 2024-07-10 19:09:16 | INFO | stdout | INFO: 10.140.60.209:34672 - "POST /worker_get_status HTTP/1.1" 200 OK
326
- 2024-07-10 19:09:17 | INFO | stdout | INFO: 10.140.60.209:34718 - "POST /worker_get_status HTTP/1.1" 200 OK
327
- 2024-07-10 19:09:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
328
- 2024-07-10 19:09:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
329
- 2024-07-10 19:09:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
330
- 2024-07-10 19:10:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
331
- 2024-07-10 19:10:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
332
- 2024-07-10 19:10:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
333
- 2024-07-10 19:10:51 | INFO | stdout | INFO: 10.140.60.209:35142 - "POST /worker_get_status HTTP/1.1" 200 OK
334
- 2024-07-10 19:10:52 | INFO | stdout | INFO: 10.140.60.209:35162 - "POST /worker_get_status HTTP/1.1" 200 OK
335
- 2024-07-10 19:10:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
336
- 2024-07-10 19:11:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
337
- 2024-07-10 19:11:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
338
- 2024-07-10 19:11:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
339
- 2024-07-10 19:11:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
340
- 2024-07-10 19:12:07 | INFO | stdout | INFO: 10.140.60.209:35462 - "POST /worker_get_status HTTP/1.1" 200 OK
341
- 2024-07-10 19:12:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
342
- 2024-07-10 19:12:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
343
- 2024-07-10 19:12:44 | INFO | stdout | INFO: 10.140.60.209:35714 - "POST /worker_get_status HTTP/1.1" 200 OK
344
- 2024-07-10 19:12:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
345
- 2024-07-10 19:12:44 | INFO | stdout | INFO: 10.140.60.209:35734 - "POST /worker_get_status HTTP/1.1" 200 OK
346
- 2024-07-10 19:12:50 | INFO | stdout | INFO: 10.140.60.209:35760 - "POST /worker_get_status HTTP/1.1" 200 OK
347
- 2024-07-10 19:12:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
348
- 2024-07-10 19:13:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
349
- 2024-07-10 19:13:17 | INFO | stdout | INFO: 10.140.60.209:35904 - "POST /worker_get_status HTTP/1.1" 200 OK
350
- 2024-07-10 19:13:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
351
- 2024-07-10 19:13:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
352
- 2024-07-10 19:13:46 | INFO | stdout | INFO: 10.140.60.209:36000 - "POST /worker_get_status HTTP/1.1" 200 OK
353
- 2024-07-10 19:13:47 | INFO | stdout | INFO: 10.140.60.209:36026 - "POST /worker_get_status HTTP/1.1" 200 OK
354
- 2024-07-10 19:13:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
355
- 2024-07-10 19:14:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
356
- 2024-07-10 19:14:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
357
- 2024-07-10 19:14:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
358
- 2024-07-10 19:14:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
359
- 2024-07-10 19:15:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
360
- 2024-07-10 19:15:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
361
- 2024-07-10 19:15:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
362
- 2024-07-10 19:15:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
363
- 2024-07-10 19:16:02 | INFO | stdout | INFO: 10.140.60.209:36498 - "POST /worker_get_status HTTP/1.1" 200 OK
364
- 2024-07-10 19:16:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
365
- 2024-07-10 19:16:16 | INFO | stdout | INFO: 10.140.60.209:36626 - "POST /worker_get_status HTTP/1.1" 200 OK
366
- 2024-07-10 19:16:23 | INFO | stdout | INFO: 10.140.60.209:36718 - "POST /worker_get_status HTTP/1.1" 200 OK
367
- 2024-07-10 19:16:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
368
- 2024-07-10 19:16:31 | INFO | stdout | INFO: 10.140.60.209:36744 - "POST /worker_get_status HTTP/1.1" 200 OK
369
- 2024-07-10 19:16:40 | INFO | stdout | INFO: 10.140.60.209:36766 - "POST /worker_get_status HTTP/1.1" 200 OK
370
- 2024-07-10 19:16:41 | INFO | stdout | INFO: 10.140.60.209:36788 - "POST /worker_get_status HTTP/1.1" 200 OK
371
- 2024-07-10 19:16:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
372
- 2024-07-10 19:17:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
373
- 2024-07-10 19:17:00 | INFO | stdout | INFO: 10.140.60.209:36818 - "POST /worker_get_status HTTP/1.1" 200 OK
374
- 2024-07-10 19:17:04 | INFO | stdout | INFO: 10.140.60.209:36838 - "POST /worker_get_status HTTP/1.1" 200 OK
375
- 2024-07-10 19:17:08 | INFO | stdout | INFO: 10.140.60.209:36860 - "POST /worker_get_status HTTP/1.1" 200 OK
376
- 2024-07-10 19:17:10 | INFO | stdout | INFO: 10.140.60.209:36880 - "POST /worker_get_status HTTP/1.1" 200 OK
377
- 2024-07-10 19:17:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
378
- 2024-07-10 19:17:19 | INFO | stdout | INFO: 10.140.60.209:37080 - "POST /worker_get_status HTTP/1.1" 200 OK
379
- 2024-07-10 19:17:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
380
- 2024-07-10 19:17:41 | INFO | stdout | INFO: 10.140.60.209:37110 - "POST /worker_get_status HTTP/1.1" 200 OK
381
- 2024-07-10 19:17:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
382
- 2024-07-10 19:17:46 | INFO | stdout | INFO: 10.140.60.209:37130 - "POST /worker_get_status HTTP/1.1" 200 OK
383
- 2024-07-10 19:17:47 | INFO | stdout | INFO: 10.140.60.209:37150 - "POST /worker_get_status HTTP/1.1" 200 OK
384
- 2024-07-10 19:17:51 | INFO | stdout | INFO: 10.140.60.209:37172 - "POST /worker_get_status HTTP/1.1" 200 OK
385
- 2024-07-10 19:17:54 | INFO | stdout | INFO: 10.140.60.209:37194 - "POST /worker_get_status HTTP/1.1" 200 OK
386
- 2024-07-10 19:18:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
387
- 2024-07-10 19:18:00 | INFO | stdout | INFO: 10.140.60.209:37220 - "POST /worker_get_status HTTP/1.1" 200 OK
388
- 2024-07-10 19:18:11 | INFO | stdout | INFO: 10.140.60.209:37242 - "POST /worker_get_status HTTP/1.1" 200 OK
389
- 2024-07-10 19:18:12 | INFO | stdout | INFO: 10.140.60.209:37276 - "POST /worker_get_status HTTP/1.1" 200 OK
390
- 2024-07-10 19:18:12 | INFO | stdout | INFO: 10.140.60.209:37304 - "POST /worker_get_status HTTP/1.1" 200 OK
391
- 2024-07-10 19:18:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
392
- 2024-07-10 19:18:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
393
- 2024-07-10 19:18:37 | INFO | stdout | INFO: 10.140.60.209:37490 - "POST /worker_get_status HTTP/1.1" 200 OK
394
- 2024-07-10 19:18:41 | INFO | stdout | INFO: 10.140.60.209:37516 - "POST /worker_get_status HTTP/1.1" 200 OK
395
- 2024-07-10 19:18:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
396
- 2024-07-10 19:18:49 | INFO | stdout | INFO: 10.140.60.209:37546 - "POST /worker_get_status HTTP/1.1" 200 OK
397
- 2024-07-10 19:18:54 | INFO | stdout | INFO: 10.140.60.209:37564 - "POST /worker_get_status HTTP/1.1" 200 OK
398
- 2024-07-10 19:18:55 | INFO | stdout | INFO: 10.140.60.209:37582 - "POST /worker_get_status HTTP/1.1" 200 OK
399
- 2024-07-10 19:19:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
400
- 2024-07-10 19:19:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
401
- 2024-07-10 19:19:21 | INFO | stdout | INFO: 10.140.60.209:37784 - "POST /worker_get_status HTTP/1.1" 200 OK
402
- 2024-07-10 19:19:22 | INFO | stdout | INFO: 10.140.60.209:37810 - "POST /worker_get_status HTTP/1.1" 200 OK
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_762b3d.log DELETED
@@ -1,125 +0,0 @@
1
- 2024-07-11 22:32:13 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40006, worker_address='http://10.140.60.25:40006', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-40B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:32:13 | INFO | model_worker | Loading the model InternVL2-40B on worker 762b3d ...
3
- 2024-07-11 22:32:13 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:32:13 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:32:15 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-11 22:32:15 | ERROR | stderr | warnings.warn(
7
- 2024-07-11 22:32:16 | ERROR | stderr |
8
- 2024-07-11 22:32:18 | ERROR | stderr |
9
- 2024-07-11 22:32:20 | ERROR | stderr |
10
- 2024-07-11 22:32:22 | ERROR | stderr |
11
- 2024-07-11 22:32:24 | ERROR | stderr |
12
- 2024-07-11 22:32:26 | ERROR | stderr |
13
- 2024-07-11 22:32:28 | ERROR | stderr |
14
- 2024-07-11 22:32:30 | ERROR | stderr |
15
- 2024-07-11 22:32:32 | ERROR | stderr |
16
- 2024-07-11 22:32:34 | ERROR | stderr |
17
- 2024-07-11 22:32:36 | ERROR | stderr |
18
- 2024-07-11 22:32:38 | ERROR | stderr |
19
- 2024-07-11 22:32:40 | ERROR | stderr |
20
- 2024-07-11 22:32:43 | ERROR | stderr |
21
- 2024-07-11 22:32:45 | ERROR | stderr |
22
- 2024-07-11 22:32:48 | ERROR | stderr |
23
- 2024-07-11 22:32:50 | ERROR | stderr |
24
- 2024-07-11 22:32:51 | ERROR | stderr |
25
- 2024-07-11 22:32:51 | ERROR | stderr |
26
- 2024-07-11 22:32:51 | ERROR | stderr |
27
- 2024-07-11 22:32:52 | INFO | model_worker | Register to controller
28
- 2024-07-11 22:32:52 | ERROR | stderr | INFO: Started server process [86159]
29
- 2024-07-11 22:32:52 | ERROR | stderr | INFO: Waiting for application startup.
30
- 2024-07-11 22:32:52 | ERROR | stderr | INFO: Application startup complete.
31
- 2024-07-11 22:32:52 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40006 (Press CTRL+C to quit)
32
- 2024-07-11 22:33:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: None. global_counter: 0
33
- 2024-07-11 22:33:11 | INFO | stdout | INFO: 10.140.60.209:48660 - "POST /worker_get_status HTTP/1.1" 200 OK
34
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:48714 - "POST /worker_get_status HTTP/1.1" 200 OK
35
- 2024-07-11 22:33:13 | INFO | stdout | INFO: 10.140.60.209:48736 - "POST /worker_get_status HTTP/1.1" 200 OK
36
- 2024-07-11 22:33:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
37
- 2024-07-11 22:33:14 | INFO | stdout | INFO: 10.140.60.209:48756 - "POST /worker_generate_stream HTTP/1.1" 200 OK
38
- 2024-07-11 22:33:14 | INFO | model_worker | max_input_tile_list: [12]
39
- 2024-07-11 22:33:14 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
40
- 2024-07-11 22:33:14 | INFO | model_worker | []
41
- 2024-07-11 22:33:14 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7f3dd8422530>}
42
- 2024-07-11 22:33:15 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
43
- 2024-07-11 22:33:15 | ERROR | stderr | warnings.warn(
44
- 2024-07-11 22:33:15 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
45
- 2024-07-11 22:33:18 | ERROR | stderr | Exception in thread Thread-3 (chat):
46
- 2024-07-11 22:33:18 | ERROR | stderr | Traceback (most recent call last):
47
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
48
- 2024-07-11 22:33:18 | ERROR | stderr | self.run()
49
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/threading.py", line 946, in run
50
- 2024-07-11 22:33:18 | ERROR | stderr | self._target(*self._args, **self._kwargs)
51
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-40B/modeling_internvl_chat.py", line 280, in chat
52
- 2024-07-11 22:33:18 | ERROR | stderr | generation_output = self.generate(
53
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
54
- 2024-07-11 22:33:18 | ERROR | stderr | return func(*args, **kwargs)
55
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-40B/modeling_internvl_chat.py", line 330, in generate
56
- 2024-07-11 22:33:18 | ERROR | stderr | outputs = self.language_model.generate(
57
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
58
- 2024-07-11 22:33:18 | ERROR | stderr | return func(*args, **kwargs)
59
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 1525, in generate
60
- 2024-07-11 22:33:18 | ERROR | stderr | return self.sample(
61
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/utils.py", line 2641, in sample
62
- 2024-07-11 22:33:18 | ERROR | stderr | next_token_scores = logits_processor(input_ids, next_token_logits)
63
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 97, in __call__
64
- 2024-07-11 22:33:18 | ERROR | stderr | scores = processor(input_ids, scores)
65
- 2024-07-11 22:33:18 | ERROR | stderr | File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/logits_process.py", line 333, in __call__
66
- 2024-07-11 22:33:18 | ERROR | stderr | score = torch.gather(scores, 1, input_ids)
67
- 2024-07-11 22:33:18 | ERROR | stderr | RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:2 and cuda:0! (when checking argument for argument index in method wrapper_CUDA_gather)
68
- 2024-07-11 22:33:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
69
- 2024-07-11 22:33:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
70
- 2024-07-11 22:33:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
71
- 2024-07-11 22:33:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
72
- 2024-07-11 22:34:02 | INFO | stdout | INFO: 10.140.60.209:49124 - "POST /worker_get_status HTTP/1.1" 200 OK
73
- 2024-07-11 22:34:04 | INFO | stdout | INFO: 10.140.60.209:49144 - "POST /worker_get_status HTTP/1.1" 200 OK
74
- 2024-07-11 22:34:05 | INFO | stdout | INFO: 10.140.60.209:49165 - "POST /worker_get_status HTTP/1.1" 200 OK
75
- 2024-07-11 22:34:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
76
- 2024-07-11 22:34:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
77
- 2024-07-11 22:34:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
78
- 2024-07-11 22:34:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
79
- 2024-07-11 22:35:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
80
- 2024-07-11 22:35:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
81
- 2024-07-11 22:35:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
82
- 2024-07-11 22:35:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
83
- 2024-07-11 22:36:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
84
- 2024-07-11 22:36:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
85
- 2024-07-11 22:36:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
86
- 2024-07-11 22:36:43 | INFO | stdout | INFO: 10.140.60.209:50210 - "POST /worker_get_status HTTP/1.1" 200 OK
87
- 2024-07-11 22:36:49 | INFO | stdout | INFO: 10.140.60.209:50228 - "POST /worker_get_status HTTP/1.1" 200 OK
88
- 2024-07-11 22:36:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
89
- 2024-07-11 22:36:57 | INFO | stdout | INFO: 10.140.60.209:50330 - "POST /worker_get_status HTTP/1.1" 200 OK
90
- 2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:50354 - "POST /worker_get_status HTTP/1.1" 200 OK
91
- 2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:50374 - "POST /worker_get_status HTTP/1.1" 200 OK
92
- 2024-07-11 22:37:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
93
- 2024-07-11 22:37:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
94
- 2024-07-11 22:37:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
95
- 2024-07-11 22:37:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
96
- 2024-07-11 22:38:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
97
- 2024-07-11 22:38:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
98
- 2024-07-11 22:38:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
99
- 2024-07-11 22:38:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
100
- 2024-07-11 22:39:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
101
- 2024-07-11 22:39:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
102
- 2024-07-11 22:39:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
103
- 2024-07-11 22:39:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
104
- 2024-07-11 22:40:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
105
- 2024-07-11 22:40:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
106
- 2024-07-11 22:40:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
107
- 2024-07-11 22:40:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
108
- 2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:52238 - "POST /worker_get_status HTTP/1.1" 200 OK
109
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:52258 - "POST /worker_get_status HTTP/1.1" 200 OK
110
- 2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:52278 - "POST /worker_get_status HTTP/1.1" 200 OK
111
- 2024-07-11 22:41:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
112
- 2024-07-11 22:41:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
113
- 2024-07-11 22:41:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
114
- 2024-07-11 22:41:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
115
- 2024-07-11 22:42:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
116
- 2024-07-11 22:42:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
117
- 2024-07-11 22:42:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
118
- 2024-07-11 22:42:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
119
- 2024-07-11 22:43:07 | INFO | stdout | INFO: 10.140.60.209:52936 - "POST /worker_get_status HTTP/1.1" 200 OK
120
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:52956 - "POST /worker_get_status HTTP/1.1" 200 OK
121
- 2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:52976 - "POST /worker_get_status HTTP/1.1" 200 OK
122
- 2024-07-11 22:43:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
123
- 2024-07-11 22:43:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
124
- 2024-07-11 22:43:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-40B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
125
- 2024-07-11 22:43:39 | ERROR | stderr | INFO: Shutting down
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_7818e5.log DELETED
@@ -1,392 +0,0 @@
1
- 2024-07-11 22:43:37 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40008, worker_address='http://10.140.60.182:40008', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-Pro/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-11 22:43:37 | INFO | model_worker | Loading the model InternVL2-Pro on worker 7818e5 ...
3
- 2024-07-11 22:43:37 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-11 22:43:37 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-11 22:43:41 | ERROR | stderr |
6
- 2024-07-11 22:43:43 | ERROR | stderr |
7
- 2024-07-11 22:43:45 | ERROR | stderr |
8
- 2024-07-11 22:43:47 | ERROR | stderr |
9
- 2024-07-11 22:43:50 | ERROR | stderr |
10
- 2024-07-11 22:43:52 | ERROR | stderr |
11
- 2024-07-11 22:43:54 | ERROR | stderr |
12
- 2024-07-11 22:43:56 | ERROR | stderr |
13
- 2024-07-11 22:43:58 | ERROR | stderr |
14
- 2024-07-11 22:44:00 | ERROR | stderr |
15
- 2024-07-11 22:44:02 | ERROR | stderr |
16
- 2024-07-11 22:44:04 | ERROR | stderr |
17
- 2024-07-11 22:44:06 | ERROR | stderr |
18
- 2024-07-11 22:44:08 | ERROR | stderr |
19
- 2024-07-11 22:44:09 | ERROR | stderr |
20
- 2024-07-11 22:44:11 | ERROR | stderr |
21
- 2024-07-11 22:44:13 | ERROR | stderr |
22
- 2024-07-11 22:44:15 | ERROR | stderr |
23
- 2024-07-11 22:44:17 | ERROR | stderr |
24
- 2024-07-11 22:44:19 | ERROR | stderr |
25
- 2024-07-11 22:44:21 | ERROR | stderr |
26
- 2024-07-11 22:44:23 | ERROR | stderr |
27
- 2024-07-11 22:44:25 | ERROR | stderr |
28
- 2024-07-11 22:44:27 | ERROR | stderr |
29
- 2024-07-11 22:44:28 | ERROR | stderr |
30
- 2024-07-11 22:44:30 | ERROR | stderr |
31
- 2024-07-11 22:44:32 | ERROR | stderr |
32
- 2024-07-11 22:44:34 | ERROR | stderr |
33
- 2024-07-11 22:44:36 | ERROR | stderr |
34
- 2024-07-11 22:44:38 | ERROR | stderr |
35
- 2024-07-11 22:44:40 | ERROR | stderr |
36
- 2024-07-11 22:44:42 | ERROR | stderr |
37
- 2024-07-11 22:44:43 | ERROR | stderr |
38
- 2024-07-11 22:44:44 | ERROR | stderr |
39
- 2024-07-11 22:44:44 | ERROR | stderr |
40
- 2024-07-11 22:44:44 | ERROR | stderr |
41
- 2024-07-11 22:44:45 | INFO | model_worker | Register to controller
42
- 2024-07-11 22:44:45 | ERROR | stderr | INFO: Started server process [38202]
43
- 2024-07-11 22:44:45 | ERROR | stderr | INFO: Waiting for application startup.
44
- 2024-07-11 22:44:45 | ERROR | stderr | INFO: Application startup complete.
45
- 2024-07-11 22:44:45 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40008 (Press CTRL+C to quit)
46
- 2024-07-11 22:45:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
47
- 2024-07-11 22:45:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
48
- 2024-07-11 22:45:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
49
- 2024-07-11 22:45:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
50
- 2024-07-11 22:46:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
51
- 2024-07-11 22:46:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
52
- 2024-07-11 22:46:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
53
- 2024-07-11 22:46:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
54
- 2024-07-11 22:47:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
55
- 2024-07-11 22:47:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
56
- 2024-07-11 22:47:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
57
- 2024-07-11 22:47:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
58
- 2024-07-11 22:48:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
59
- 2024-07-11 22:48:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
60
- 2024-07-11 22:48:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
61
- 2024-07-11 22:48:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
62
- 2024-07-11 22:49:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
63
- 2024-07-11 22:49:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
64
- 2024-07-11 22:49:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
65
- 2024-07-11 22:49:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
66
- 2024-07-11 22:50:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
67
- 2024-07-11 22:50:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
68
- 2024-07-11 22:50:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
69
- 2024-07-11 22:50:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
70
- 2024-07-11 22:50:54 | INFO | stdout | INFO: 10.140.60.209:52386 - "POST /worker_get_status HTTP/1.1" 200 OK
71
- 2024-07-11 22:51:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
72
- 2024-07-11 22:51:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
73
- 2024-07-11 22:51:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
74
- 2024-07-11 22:51:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
75
- 2024-07-11 22:52:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
76
- 2024-07-11 22:52:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
77
- 2024-07-11 22:52:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
78
- 2024-07-11 22:52:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
79
- 2024-07-11 22:53:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
80
- 2024-07-11 22:53:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
81
- 2024-07-11 22:53:28 | INFO | stdout | INFO: 10.140.60.209:53308 - "POST /worker_get_status HTTP/1.1" 200 OK
82
- 2024-07-11 22:53:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
83
- 2024-07-11 22:53:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
84
- 2024-07-11 22:54:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
85
- 2024-07-11 22:54:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
86
- 2024-07-11 22:54:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
87
- 2024-07-11 22:54:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
88
- 2024-07-11 22:55:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
89
- 2024-07-11 22:55:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
90
- 2024-07-11 22:55:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
91
- 2024-07-11 22:55:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
92
- 2024-07-11 22:56:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
93
- 2024-07-11 22:56:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
94
- 2024-07-11 22:56:22 | INFO | stdout | INFO: 10.140.60.209:54260 - "POST /worker_get_status HTTP/1.1" 200 OK
95
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:54280 - "POST /worker_get_status HTTP/1.1" 200 OK
96
- 2024-07-11 22:56:24 | INFO | stdout | INFO: 10.140.60.209:54300 - "POST /worker_get_status HTTP/1.1" 200 OK
97
- 2024-07-11 22:56:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
98
- 2024-07-11 22:56:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
99
- 2024-07-11 22:57:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
100
- 2024-07-11 22:57:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
101
- 2024-07-11 22:57:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
102
- 2024-07-11 22:57:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
103
- 2024-07-11 22:58:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
104
- 2024-07-11 22:58:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
105
- 2024-07-11 22:58:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
106
- 2024-07-11 22:58:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
107
- 2024-07-11 22:59:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
108
- 2024-07-11 22:59:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
109
- 2024-07-11 22:59:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
110
- 2024-07-11 22:59:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
111
- 2024-07-11 23:00:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
112
- 2024-07-11 23:00:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
113
- 2024-07-11 23:00:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
114
- 2024-07-11 23:00:45 | INFO | stdout | INFO: 10.140.60.209:55728 - "POST /worker_get_status HTTP/1.1" 200 OK
115
- 2024-07-11 23:00:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
116
- 2024-07-11 23:01:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
117
- 2024-07-11 23:01:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
118
- 2024-07-11 23:01:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
119
- 2024-07-11 23:01:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
120
- 2024-07-11 23:02:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
121
- 2024-07-11 23:02:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
122
- 2024-07-11 23:02:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
123
- 2024-07-11 23:02:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
124
- 2024-07-11 23:03:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
125
- 2024-07-11 23:03:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
126
- 2024-07-11 23:03:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
127
- 2024-07-11 23:03:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
128
- 2024-07-11 23:04:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
129
- 2024-07-11 23:04:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
130
- 2024-07-11 23:04:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
131
- 2024-07-11 23:04:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
132
- 2024-07-11 23:05:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
133
- 2024-07-11 23:05:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
134
- 2024-07-11 23:05:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
135
- 2024-07-11 23:05:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
136
- 2024-07-11 23:06:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
137
- 2024-07-11 23:06:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
138
- 2024-07-11 23:06:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
139
- 2024-07-11 23:06:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
140
- 2024-07-11 23:07:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
141
- 2024-07-11 23:07:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
142
- 2024-07-11 23:07:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
143
- 2024-07-11 23:07:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
144
- 2024-07-11 23:08:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
145
- 2024-07-11 23:08:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
146
- 2024-07-11 23:08:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
147
- 2024-07-11 23:08:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
148
- 2024-07-11 23:09:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
149
- 2024-07-11 23:09:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
150
- 2024-07-11 23:09:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
151
- 2024-07-11 23:09:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
152
- 2024-07-11 23:10:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
153
- 2024-07-11 23:10:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
154
- 2024-07-11 23:10:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
155
- 2024-07-11 23:10:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
156
- 2024-07-11 23:11:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
157
- 2024-07-11 23:11:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
158
- 2024-07-11 23:11:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
159
- 2024-07-11 23:11:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
160
- 2024-07-11 23:12:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
161
- 2024-07-11 23:12:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
162
- 2024-07-11 23:12:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
163
- 2024-07-11 23:12:45 | INFO | stdout | INFO: 10.140.60.209:60680 - "POST /worker_get_status HTTP/1.1" 200 OK
164
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:60700 - "POST /worker_get_status HTTP/1.1" 200 OK
165
- 2024-07-11 23:12:47 | INFO | stdout | INFO: 10.140.60.209:60728 - "POST /worker_get_status HTTP/1.1" 200 OK
166
- 2024-07-11 23:12:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
167
- 2024-07-11 23:13:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
168
- 2024-07-11 23:13:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
169
- 2024-07-11 23:13:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
170
- 2024-07-11 23:13:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
171
- 2024-07-11 23:14:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
172
- 2024-07-11 23:14:08 | INFO | stdout | INFO: 10.140.60.209:33026 - "POST /worker_get_status HTTP/1.1" 200 OK
173
- 2024-07-11 23:14:13 | INFO | stdout | INFO: 10.140.60.209:33092 - "POST /worker_get_status HTTP/1.1" 200 OK
174
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:33172 - "POST /worker_get_status HTTP/1.1" 200 OK
175
- 2024-07-11 23:14:16 | INFO | stdout | INFO: 10.140.60.209:33198 - "POST /worker_get_status HTTP/1.1" 200 OK
176
- 2024-07-11 23:14:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
177
- 2024-07-11 23:14:21 | INFO | stdout | INFO: 10.140.60.209:33360 - "POST /worker_get_status HTTP/1.1" 200 OK
178
- 2024-07-11 23:14:23 | INFO | stdout | INFO: 10.140.60.209:33434 - "POST /worker_get_status HTTP/1.1" 200 OK
179
- 2024-07-11 23:14:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
180
- 2024-07-11 23:14:33 | INFO | stdout | INFO: 10.140.60.209:33468 - "POST /worker_get_status HTTP/1.1" 200 OK
181
- 2024-07-11 23:14:37 | INFO | stdout | INFO: 10.140.60.209:33488 - "POST /worker_get_status HTTP/1.1" 200 OK
182
- 2024-07-11 23:14:38 | INFO | stdout | INFO: 10.140.60.209:33508 - "POST /worker_get_status HTTP/1.1" 200 OK
183
- 2024-07-11 23:14:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
184
- 2024-07-11 23:15:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
185
- 2024-07-11 23:15:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
186
- 2024-07-11 23:15:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
187
- 2024-07-11 23:15:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
188
- 2024-07-11 23:16:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
189
- 2024-07-11 23:16:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
190
- 2024-07-11 23:16:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
191
- 2024-07-11 23:16:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
192
- 2024-07-11 23:17:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
193
- 2024-07-11 23:17:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
194
- 2024-07-11 23:17:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
195
- 2024-07-11 23:17:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
196
- 2024-07-11 23:18:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
197
- 2024-07-11 23:18:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
198
- 2024-07-11 23:18:20 | INFO | stdout | INFO: 10.140.60.209:35200 - "POST /worker_get_status HTTP/1.1" 200 OK
199
- 2024-07-11 23:18:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
200
- 2024-07-11 23:18:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
201
- 2024-07-11 23:19:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
202
- 2024-07-11 23:19:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
203
- 2024-07-11 23:19:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
204
- 2024-07-11 23:19:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
205
- 2024-07-11 23:20:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
206
- 2024-07-11 23:20:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
207
- 2024-07-11 23:20:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
208
- 2024-07-11 23:20:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
209
- 2024-07-11 23:21:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
210
- 2024-07-11 23:21:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
211
- 2024-07-11 23:21:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
212
- 2024-07-11 23:21:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
213
- 2024-07-11 23:22:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
214
- 2024-07-11 23:22:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
215
- 2024-07-11 23:22:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
216
- 2024-07-11 23:22:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
217
- 2024-07-11 23:23:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
218
- 2024-07-11 23:23:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
219
- 2024-07-11 23:23:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
220
- 2024-07-11 23:23:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
221
- 2024-07-11 23:24:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
222
- 2024-07-11 23:24:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
223
- 2024-07-11 23:24:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
224
- 2024-07-11 23:24:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
225
- 2024-07-11 23:25:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
226
- 2024-07-11 23:25:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
227
- 2024-07-11 23:25:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
228
- 2024-07-11 23:25:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
229
- 2024-07-11 23:26:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
230
- 2024-07-11 23:26:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
231
- 2024-07-11 23:26:29 | INFO | stdout | INFO: 10.140.60.209:38374 - "POST /worker_get_status HTTP/1.1" 200 OK
232
- 2024-07-11 23:26:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
233
- 2024-07-11 23:26:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
234
- 2024-07-11 23:26:48 | INFO | stdout | INFO: 10.140.60.209:38446 - "POST /worker_get_status HTTP/1.1" 200 OK
235
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:38518 - "POST /worker_get_status HTTP/1.1" 200 OK
236
- 2024-07-11 23:26:53 | INFO | stdout | INFO: 10.140.60.209:38546 - "POST /worker_get_status HTTP/1.1" 200 OK
237
- 2024-07-11 23:27:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
238
- 2024-07-11 23:27:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
239
- 2024-07-11 23:27:29 | INFO | stdout | INFO: 10.140.60.209:38842 - "POST /worker_get_status HTTP/1.1" 200 OK
240
- 2024-07-11 23:27:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
241
- 2024-07-11 23:27:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
242
- 2024-07-11 23:28:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
243
- 2024-07-11 23:28:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
244
- 2024-07-11 23:28:29 | INFO | stdout | INFO: 10.140.60.209:39318 - "POST /worker_get_status HTTP/1.1" 200 OK
245
- 2024-07-11 23:28:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
246
- 2024-07-11 23:28:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
247
- 2024-07-11 23:29:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
248
- 2024-07-11 23:29:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
249
- 2024-07-11 23:29:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
250
- 2024-07-11 23:29:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
251
- 2024-07-11 23:30:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
252
- 2024-07-11 23:30:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
253
- 2024-07-11 23:30:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
254
- 2024-07-11 23:30:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
255
- 2024-07-11 23:31:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
256
- 2024-07-11 23:31:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
257
- 2024-07-11 23:31:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
258
- 2024-07-11 23:31:35 | INFO | stdout | INFO: 10.140.60.209:40498 - "POST /worker_get_status HTTP/1.1" 200 OK
259
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:40518 - "POST /worker_get_status HTTP/1.1" 200 OK
260
- 2024-07-11 23:31:37 | INFO | stdout | INFO: 10.140.60.209:40538 - "POST /worker_get_status HTTP/1.1" 200 OK
261
- 2024-07-11 23:31:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
262
- 2024-07-11 23:31:51 | INFO | stdout | INFO: 10.140.60.209:40574 - "POST /worker_get_status HTTP/1.1" 200 OK
263
- 2024-07-11 23:32:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
264
- 2024-07-11 23:32:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
265
- 2024-07-11 23:32:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
266
- 2024-07-11 23:32:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
267
- 2024-07-11 23:33:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
268
- 2024-07-11 23:33:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
269
- 2024-07-11 23:33:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
270
- 2024-07-11 23:33:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
271
- 2024-07-11 23:34:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
272
- 2024-07-11 23:34:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
273
- 2024-07-11 23:34:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
274
- 2024-07-11 23:34:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
275
- 2024-07-11 23:35:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
276
- 2024-07-11 23:35:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
277
- 2024-07-11 23:35:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
278
- 2024-07-11 23:35:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
279
- 2024-07-11 23:36:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
280
- 2024-07-11 23:36:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
281
- 2024-07-11 23:36:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
282
- 2024-07-11 23:36:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
283
- 2024-07-11 23:37:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
284
- 2024-07-11 23:37:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
285
- 2024-07-11 23:37:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
286
- 2024-07-11 23:37:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
287
- 2024-07-11 23:38:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
288
- 2024-07-11 23:38:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
289
- 2024-07-11 23:38:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
290
- 2024-07-11 23:38:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
291
- 2024-07-11 23:39:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
292
- 2024-07-11 23:39:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
293
- 2024-07-11 23:39:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
294
- 2024-07-11 23:39:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
295
- 2024-07-11 23:40:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
296
- 2024-07-11 23:40:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
297
- 2024-07-11 23:40:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
298
- 2024-07-11 23:40:41 | INFO | stdout | INFO: 10.140.60.209:43962 - "POST /worker_get_status HTTP/1.1" 200 OK
299
- 2024-07-11 23:40:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
300
- 2024-07-11 23:41:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
301
- 2024-07-11 23:41:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
302
- 2024-07-11 23:41:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
303
- 2024-07-11 23:41:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
304
- 2024-07-11 23:42:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
305
- 2024-07-11 23:42:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
306
- 2024-07-11 23:42:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
307
- 2024-07-11 23:42:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
308
- 2024-07-11 23:43:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
309
- 2024-07-11 23:43:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
310
- 2024-07-11 23:43:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
311
- 2024-07-11 23:43:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
312
- 2024-07-11 23:44:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
313
- 2024-07-11 23:44:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
314
- 2024-07-11 23:44:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
315
- 2024-07-11 23:44:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
316
- 2024-07-11 23:45:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
317
- 2024-07-11 23:45:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
318
- 2024-07-11 23:45:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
319
- 2024-07-11 23:45:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
320
- 2024-07-11 23:46:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
321
- 2024-07-11 23:46:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
322
- 2024-07-11 23:46:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
323
- 2024-07-11 23:46:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
324
- 2024-07-11 23:47:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
325
- 2024-07-11 23:47:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
326
- 2024-07-11 23:47:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
327
- 2024-07-11 23:47:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
328
- 2024-07-11 23:48:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
329
- 2024-07-11 23:48:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
330
- 2024-07-11 23:48:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
331
- 2024-07-11 23:48:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
332
- 2024-07-11 23:49:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
333
- 2024-07-11 23:49:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
334
- 2024-07-11 23:49:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
335
- 2024-07-11 23:49:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
336
- 2024-07-11 23:50:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
337
- 2024-07-11 23:50:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
338
- 2024-07-11 23:50:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
339
- 2024-07-11 23:50:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
340
- 2024-07-11 23:51:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
341
- 2024-07-11 23:51:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
342
- 2024-07-11 23:51:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
343
- 2024-07-11 23:51:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
344
- 2024-07-11 23:52:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
345
- 2024-07-11 23:52:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
346
- 2024-07-11 23:52:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
347
- 2024-07-11 23:52:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
348
- 2024-07-11 23:53:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
349
- 2024-07-11 23:53:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
350
- 2024-07-11 23:53:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
351
- 2024-07-11 23:53:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
352
- 2024-07-11 23:54:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
353
- 2024-07-11 23:54:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
354
- 2024-07-11 23:54:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
355
- 2024-07-11 23:54:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
356
- 2024-07-11 23:55:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
357
- 2024-07-11 23:55:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
358
- 2024-07-11 23:55:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
359
- 2024-07-11 23:55:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
360
- 2024-07-11 23:56:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
361
- 2024-07-11 23:56:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
362
- 2024-07-11 23:56:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
363
- 2024-07-11 23:56:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
364
- 2024-07-11 23:57:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
365
- 2024-07-11 23:57:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
366
- 2024-07-11 23:57:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
367
- 2024-07-11 23:57:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
368
- 2024-07-11 23:58:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
369
- 2024-07-11 23:58:09 | INFO | stdout | INFO: 10.140.60.209:50848 - "POST /worker_get_status HTTP/1.1" 200 OK
370
- 2024-07-11 23:58:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
371
- 2024-07-11 23:58:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
372
- 2024-07-11 23:58:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
373
- 2024-07-11 23:59:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
374
- 2024-07-11 23:59:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
375
- 2024-07-11 23:59:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
376
- 2024-07-11 23:59:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
377
- 2024-07-12 00:00:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
378
- 2024-07-12 00:00:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
379
- 2024-07-12 00:00:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
380
- 2024-07-12 00:00:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
381
- 2024-07-12 00:01:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
382
- 2024-07-12 00:01:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
383
- 2024-07-12 00:01:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
384
- 2024-07-12 00:01:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
385
- 2024-07-12 00:02:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
386
- 2024-07-12 00:02:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
387
- 2024-07-12 00:02:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
388
- 2024-07-12 00:02:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
389
- 2024-07-12 00:03:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
390
- 2024-07-12 00:03:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
391
- 2024-07-12 00:03:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
392
- 2024-07-12 00:03:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_783296.log DELETED
@@ -1,15 +0,0 @@
1
- 2024-07-10 17:33:00 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40002, worker_address='http://10.140.60.25:40002', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-2B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 17:33:00 | INFO | model_worker | Loading the model InternVL2-2B on worker 783296 ...
3
- 2024-07-10 17:33:01 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 17:33:01 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 17:33:09 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 17:33:09 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 17:33:22 | INFO | model_worker | Register to controller
8
- 2024-07-10 17:33:22 | ERROR | stderr | Traceback (most recent call last):
9
- 2024-07-10 17:33:22 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 359, in <module>
10
- 2024-07-10 17:33:22 | ERROR | stderr | worker = ModelWorker(args.controller_address,
11
- 2024-07-10 17:33:22 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 154, in __init__
12
- 2024-07-10 17:33:22 | ERROR | stderr | self.register_to_controller()
13
- 2024-07-10 17:33:22 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 169, in register_to_controller
14
- 2024-07-10 17:33:22 | ERROR | stderr | assert r.status_code == 200
15
- 2024-07-10 17:33:22 | ERROR | stderr | AssertionError
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_7b81e4.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_7b81e4.log.2024-07-10 DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_7c887a.log DELETED
@@ -1,20 +0,0 @@
1
- 2024-07-10 18:08:24 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.60.182:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-40B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 18:08:24 | INFO | model_worker | Loading the model InternVL2-40B on worker 7c887a ...
3
- 2024-07-10 18:08:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 18:08:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 18:08:30 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
6
- 2024-07-10 18:08:30 | ERROR | stderr | warnings.warn(
7
- 2024-07-10 18:08:33 | ERROR | stderr |
8
- 2024-07-10 18:08:35 | ERROR | stderr |
9
- 2024-07-10 18:08:38 | ERROR | stderr |
10
- 2024-07-10 18:08:40 | ERROR | stderr |
11
- 2024-07-10 18:08:42 | ERROR | stderr |
12
- 2024-07-10 18:08:45 | ERROR | stderr |
13
- 2024-07-10 18:08:47 | ERROR | stderr |
14
- 2024-07-10 18:08:49 | ERROR | stderr |
15
- 2024-07-10 18:08:52 | ERROR | stderr |
16
- 2024-07-10 18:08:54 | ERROR | stderr |
17
- 2024-07-10 18:08:56 | ERROR | stderr |
18
- 2024-07-10 18:08:58 | ERROR | stderr |
19
- 2024-07-10 18:09:00 | ERROR | stderr |
20
- 2024-07-10 18:09:03 | ERROR | stderr |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_7f44d1.log DELETED
@@ -1,13 +0,0 @@
1
- 2024-07-10 02:05:24 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 02:05:24 | INFO | model_worker | Loading the model InternVL2-1B on worker 7f44d1 ...
3
- 2024-07-10 02:05:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 02:05:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 02:05:36 | INFO | model_worker | Register to controller
6
- 2024-07-10 02:05:36 | ERROR | stderr | Traceback (most recent call last):
7
- 2024-07-10 02:05:36 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 373, in <module>
8
- 2024-07-10 02:05:36 | ERROR | stderr | worker = ModelWorker(args.controller_address,
9
- 2024-07-10 02:05:36 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 161, in __init__
10
- 2024-07-10 02:05:36 | ERROR | stderr | self.register_to_controller()
11
- 2024-07-10 02:05:36 | ERROR | stderr | File "/mnt/hwfile/wangweiyun/workspace_cz/InternVL/streamlit_demo/model_worker.py", line 176, in register_to_controller
12
- 2024-07-10 02:05:36 | ERROR | stderr | assert r.status_code == 200
13
- 2024-07-10 02:05:36 | ERROR | stderr | AssertionError
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_8e389c.log DELETED
@@ -1,75 +0,0 @@
1
- 2024-07-10 03:40:29 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 03:40:29 | INFO | model_worker | Loading the model InternVL2-1B on worker 8e389c ...
3
- 2024-07-10 03:40:29 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 03:40:29 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 03:40:31 | INFO | model_worker | Register to controller
6
- 2024-07-10 03:40:31 | ERROR | stderr | INFO: Started server process [94419]
7
- 2024-07-10 03:40:31 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 03:40:31 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 03:40:31 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 03:40:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
11
- 2024-07-10 03:40:52 | INFO | stdout | INFO: 10.140.60.209:45088 - "POST /worker_get_status HTTP/1.1" 200 OK
12
- 2024-07-10 03:40:54 | INFO | stdout | INFO: 10.140.60.209:45094 - "POST /worker_get_status HTTP/1.1" 200 OK
13
- 2024-07-10 03:40:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
14
- 2024-07-10 03:40:55 | INFO | stdout | INFO: 10.140.60.209:45100 - "POST /worker_generate_stream HTTP/1.1" 200 OK
15
- 2024-07-10 03:40:55 | INFO | stdout | history: []
16
- 2024-07-10 03:40:55 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F7AF0375000>]
17
- 2024-07-10 03:40:55 | INFO | stdout | Caught Unknown Error local variable 'images' referenced before assignment
18
- 2024-07-10 03:40:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
19
- 2024-07-10 03:41:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
20
- 2024-07-10 03:41:11 | INFO | stdout | INFO: 10.140.60.209:45110 - "POST /worker_get_status HTTP/1.1" 200 OK
21
- 2024-07-10 03:41:13 | INFO | stdout | INFO: 10.140.60.209:45154 - "POST /worker_get_status HTTP/1.1" 200 OK
22
- 2024-07-10 03:41:13 | INFO | stdout | INFO: 10.140.60.209:45166 - "POST /worker_get_status HTTP/1.1" 200 OK
23
- 2024-07-10 03:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
24
- 2024-07-10 03:41:14 | INFO | stdout | INFO: 10.140.60.209:45190 - "POST /worker_generate_stream HTTP/1.1" 200 OK
25
- 2024-07-10 03:41:14 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', '']]
26
- 2024-07-10 03:41:14 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F7AF03B6E90>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=571x1280 at 0x7F7AF03B6EF0>]
27
- 2024-07-10 03:41:14 | INFO | stdout | Caught Unknown Error local variable 'images' referenced before assignment
28
- 2024-07-10 03:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
29
- 2024-07-10 03:41:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
30
- 2024-07-10 03:41:28 | INFO | stdout | INFO: 10.140.60.209:45278 - "POST /worker_get_status HTTP/1.1" 200 OK
31
- 2024-07-10 03:41:30 | INFO | stdout | INFO: 10.140.60.209:45286 - "POST /worker_get_status HTTP/1.1" 200 OK
32
- 2024-07-10 03:41:30 | INFO | stdout | INFO: 10.140.60.209:45292 - "POST /worker_get_status HTTP/1.1" 200 OK
33
- 2024-07-10 03:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
34
- 2024-07-10 03:41:31 | INFO | stdout | INFO: 10.140.60.209:45298 - "POST /worker_generate_stream HTTP/1.1" 200 OK
35
- 2024-07-10 03:41:31 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', ''], ['Image-2: <image>\nddd', '']]
36
- 2024-07-10 03:41:31 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F7AF03B72B0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=571x1280 at 0x7F7AF03B74C0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F7AF03B7520>]
37
- 2024-07-10 03:41:31 | INFO | stdout | Caught Unknown Error local variable 'images' referenced before assignment
38
- 2024-07-10 03:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
39
- 2024-07-10 03:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
40
- 2024-07-10 03:41:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
41
- 2024-07-10 03:42:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
42
- 2024-07-10 03:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
43
- 2024-07-10 03:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
44
- 2024-07-10 03:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
45
- 2024-07-10 03:43:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
46
- 2024-07-10 03:43:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
47
- 2024-07-10 03:43:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
48
- 2024-07-10 03:43:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
49
- 2024-07-10 03:44:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
50
- 2024-07-10 03:44:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
51
- 2024-07-10 03:44:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
52
- 2024-07-10 03:44:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
53
- 2024-07-10 03:45:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
54
- 2024-07-10 03:45:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
55
- 2024-07-10 03:45:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
56
- 2024-07-10 03:45:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
57
- 2024-07-10 03:46:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
58
- 2024-07-10 03:46:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
59
- 2024-07-10 03:46:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
60
- 2024-07-10 03:46:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
61
- 2024-07-10 03:47:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
62
- 2024-07-10 03:47:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
63
- 2024-07-10 03:47:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
64
- 2024-07-10 03:47:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
65
- 2024-07-10 03:48:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
66
- 2024-07-10 03:48:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
67
- 2024-07-10 03:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
68
- 2024-07-10 03:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
69
- 2024-07-10 03:49:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
70
- 2024-07-10 03:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
71
- 2024-07-10 03:49:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
72
- 2024-07-10 03:49:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
73
- 2024-07-10 03:50:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
74
- 2024-07-10 03:50:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
75
- 2024-07-10 03:50:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_91b7e4.log DELETED
@@ -1,64 +0,0 @@
1
- 2024-07-10 03:30:07 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 03:30:07 | INFO | model_worker | Loading the model InternVL2-1B on worker 91b7e4 ...
3
- 2024-07-10 03:30:07 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 03:30:07 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 03:30:10 | INFO | model_worker | Register to controller
6
- 2024-07-10 03:30:10 | ERROR | stderr | INFO: Started server process [70957]
7
- 2024-07-10 03:30:10 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 03:30:10 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 03:30:10 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 03:30:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
11
- 2024-07-10 03:30:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
12
- 2024-07-10 03:30:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
13
- 2024-07-10 03:31:02 | INFO | stdout | INFO: 10.140.60.209:43487 - "POST /worker_get_status HTTP/1.1" 200 OK
14
- 2024-07-10 03:31:04 | INFO | stdout | INFO: 10.140.60.209:43492 - "POST /worker_get_status HTTP/1.1" 200 OK
15
- 2024-07-10 03:31:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
16
- 2024-07-10 03:31:04 | INFO | stdout | INFO: 10.140.60.209:43498 - "POST /worker_generate_stream HTTP/1.1" 200 OK
17
- 2024-07-10 03:31:04 | INFO | model_worker | max_input_tiles: 12
18
- 2024-07-10 03:31:04 | INFO | stdout | history: [['Describe this image in detail.']]
19
- 2024-07-10 03:31:04 | INFO | stdout | Caught Unknown Error name 'model' is not defined
20
- 2024-07-10 03:31:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
21
- 2024-07-10 03:31:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
22
- 2024-07-10 03:31:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
23
- 2024-07-10 03:31:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
24
- 2024-07-10 03:31:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
25
- 2024-07-10 03:32:09 | INFO | stdout | INFO: 10.140.60.209:43666 - "POST /worker_get_status HTTP/1.1" 200 OK
26
- 2024-07-10 03:32:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
27
- 2024-07-10 03:32:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
28
- 2024-07-10 03:32:10 | INFO | stdout | INFO: 10.140.60.209:43672 - "POST /worker_generate_stream HTTP/1.1" 200 OK
29
- 2024-07-10 03:32:10 | INFO | model_worker | max_input_tiles: 12
30
- 2024-07-10 03:32:10 | INFO | stdout | history: [['Describe this image in detail.', ''], ['sss']]
31
- 2024-07-10 03:32:10 | INFO | stdout | Caught Unknown Error name 'model' is not defined
32
- 2024-07-10 03:32:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
33
- 2024-07-10 03:32:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
34
- 2024-07-10 03:32:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
35
- 2024-07-10 03:32:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
36
- 2024-07-10 03:33:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
37
- 2024-07-10 03:33:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
38
- 2024-07-10 03:33:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
39
- 2024-07-10 03:33:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
40
- 2024-07-10 03:34:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
41
- 2024-07-10 03:34:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
42
- 2024-07-10 03:34:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
43
- 2024-07-10 03:34:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
44
- 2024-07-10 03:35:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
45
- 2024-07-10 03:35:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
46
- 2024-07-10 03:35:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
47
- 2024-07-10 03:35:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
48
- 2024-07-10 03:36:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
49
- 2024-07-10 03:36:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
50
- 2024-07-10 03:36:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
51
- 2024-07-10 03:36:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
52
- 2024-07-10 03:37:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
53
- 2024-07-10 03:37:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
54
- 2024-07-10 03:37:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
55
- 2024-07-10 03:37:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
56
- 2024-07-10 03:38:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
57
- 2024-07-10 03:38:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
58
- 2024-07-10 03:38:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
59
- 2024-07-10 03:38:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
60
- 2024-07-10 03:39:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
61
- 2024-07-10 03:39:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
62
- 2024-07-10 03:39:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
63
- 2024-07-10 03:39:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
64
- 2024-07-10 03:40:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
logs/model_worker_9a9b40.log DELETED
The diff for this file is too large to render. See raw diff
 
logs/model_worker_a0e470.log DELETED
@@ -1,386 +0,0 @@
1
- 2024-07-10 04:10:09 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2
- 2024-07-10 04:10:09 | INFO | model_worker | Loading the model InternVL2-1B on worker a0e470 ...
3
- 2024-07-10 04:10:09 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
4
- 2024-07-10 04:10:09 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
5
- 2024-07-10 04:10:14 | INFO | model_worker | Register to controller
6
- 2024-07-10 04:10:14 | ERROR | stderr | INFO: Started server process [29872]
7
- 2024-07-10 04:10:14 | ERROR | stderr | INFO: Waiting for application startup.
8
- 2024-07-10 04:10:14 | ERROR | stderr | INFO: Application startup complete.
9
- 2024-07-10 04:10:14 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
10
- 2024-07-10 04:10:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
11
- 2024-07-10 04:10:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
12
- 2024-07-10 04:10:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
13
- 2024-07-10 04:11:07 | INFO | stdout | INFO: 10.140.60.209:50152 - "POST /worker_get_status HTTP/1.1" 200 OK
14
- 2024-07-10 04:11:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
15
- 2024-07-10 04:11:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
16
- 2024-07-10 04:11:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
17
- 2024-07-10 04:11:55 | INFO | stdout | INFO: 10.140.60.209:50316 - "POST /worker_get_status HTTP/1.1" 200 OK
18
- 2024-07-10 04:11:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
19
- 2024-07-10 04:11:56 | INFO | stdout | INFO: 10.140.60.209:50330 - "POST /worker_generate_stream HTTP/1.1" 200 OK
20
- 2024-07-10 04:11:56 | INFO | stdout | history: []
21
- 2024-07-10 04:11:56 | INFO | stdout | question: Image-1: <image>
22
- 2024-07-10 04:11:56 | INFO | stdout | Describe this image in detail.
23
- 2024-07-10 04:11:56 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3A8310>]
24
- 2024-07-10 04:11:56 | INFO | model_worker | dynamic_image_size: True
25
- 2024-07-10 04:11:56 | INFO | model_worker | use_thumbnail: True
26
- 2024-07-10 04:11:56 | INFO | model_worker | Resize images to 448x448
27
- 2024-07-10 04:11:56 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
28
- 2024-07-10 04:11:57 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
29
- 2024-07-10 04:11:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
30
- 2024-07-10 04:12:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
31
- 2024-07-10 04:12:10 | INFO | stdout | INFO: 10.140.60.209:50338 - "POST /worker_get_status HTTP/1.1" 200 OK
32
- 2024-07-10 04:12:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
33
- 2024-07-10 04:12:11 | INFO | stdout | INFO: 10.140.60.209:50344 - "POST /worker_generate_stream HTTP/1.1" 200 OK
34
- 2024-07-10 04:12:11 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', 'The image depicts a tractor plowing a field during what appears to be either sunrise or sunset. The sky is bathed in warm hues of orange and yellow, creating a dramatic and serene atmosphere. The tractor, which is the central focus of the image, is heavily laden with freshly plowed soil, indicating recent harvesting activity. \n\nThe tractor is robust and features large, deep-tread tires, which are ideal for navigating the uneven terrain of the field. The front of the tractor has a large, prominent grille and a large front bumper, adding to its sturdy appearance. The side of the tractor is painted red, which contrasts sharply with the earthy tones of the field and the surrounding environment.\n\nIn the background, there is a small group of people working alongside the tractor. They appear to be in the process of plowing or tilling the field, with one individual operating a small piece of agricultural equipment. The individuals are dressed in work attire, likely to protect themselves from the sun.\n\nBeyond the immediate field, a gentle slope of trees and hills can be seen, adding depth to the image and providing a sense of scale. The lighting and shadows create a dynamic and compelling visual effect, emphasizing the movement and activity of the tractor amidst the tranquil landscape.']]
35
- 2024-07-10 04:12:11 | INFO | stdout | question: 说中文
36
- 2024-07-10 04:12:11 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EE470>]
37
- 2024-07-10 04:12:11 | INFO | model_worker | dynamic_image_size: True
38
- 2024-07-10 04:12:11 | INFO | model_worker | use_thumbnail: True
39
- 2024-07-10 04:12:11 | INFO | model_worker | Resize images to 448x448
40
- 2024-07-10 04:12:11 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
41
- 2024-07-10 04:12:11 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
42
- 2024-07-10 04:12:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
43
- 2024-07-10 04:12:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
44
- 2024-07-10 04:12:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
45
- 2024-07-10 04:12:40 | INFO | stdout | INFO: 10.140.60.209:50492 - "POST /worker_get_status HTTP/1.1" 200 OK
46
- 2024-07-10 04:12:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
47
- 2024-07-10 04:12:41 | INFO | stdout | INFO: 10.140.60.209:50498 - "POST /worker_generate_stream HTTP/1.1" 200 OK
48
- 2024-07-10 04:12:41 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', 'The image depicts a tractor plowing a field during what appears to be either sunrise or sunset. The sky is bathed in warm hues of orange and yellow, creating a dramatic and serene atmosphere. The tractor, which is the central focus of the image, is heavily laden with freshly plowed soil, indicating recent harvesting activity. \n\nThe tractor is robust and features large, deep-tread tires, which are ideal for navigating the uneven terrain of the field. The front of the tractor has a large, prominent grille and a large front bumper, adding to its sturdy appearance. The side of the tractor is painted red, which contrasts sharply with the earthy tones of the field and the surrounding environment.\n\nIn the background, there is a small group of people working alongside the tractor. They appear to be in the process of plowing or tilling the field, with one individual operating a small piece of agricultural equipment. The individuals are dressed in work attire, likely to protect themselves from the sun.\n\nBeyond the immediate field, a gentle slope of trees and hills can be seen, adding depth to the image and providing a sense of scale. The lighting and shadows create a dynamic and compelling visual effect, emphasizing the movement and activity of the tractor amidst the tranquil landscape.'], ['说中文', '这张图片展示了一辆正在田间作业的拖拉机。拖拉机正在地里犁地，尘土飞扬，显示出它正在努力工作。背景中可以看到一些树木和远处的山脉，天空呈现出柔和的橙黄色，可能是日出或日落时分的景象。']]
49
- 2024-07-10 04:12:41 | INFO | stdout | question: 你是谁
50
- 2024-07-10 04:12:41 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EEBC0>]
51
- 2024-07-10 04:12:41 | INFO | model_worker | dynamic_image_size: True
52
- 2024-07-10 04:12:41 | INFO | model_worker | use_thumbnail: True
53
- 2024-07-10 04:12:41 | INFO | model_worker | Resize images to 448x448
54
- 2024-07-10 04:12:41 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
55
- 2024-07-10 04:12:41 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
56
- 2024-07-10 04:12:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
57
- 2024-07-10 04:12:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
58
- 2024-07-10 04:12:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
59
- 2024-07-10 04:13:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
60
- 2024-07-10 04:13:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
61
- 2024-07-10 04:13:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
62
- 2024-07-10 04:13:46 | INFO | stdout | INFO: 10.140.60.209:50652 - "POST /worker_get_status HTTP/1.1" 200 OK
63
- 2024-07-10 04:13:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
64
- 2024-07-10 04:13:47 | INFO | stdout | INFO: 10.140.60.209:50658 - "POST /worker_generate_stream HTTP/1.1" 200 OK
65
- 2024-07-10 04:13:47 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', 'The image depicts a tractor plowing a field during what appears to be either sunrise or sunset. The sky is bathed in warm hues of orange and yellow, creating a dramatic and serene atmosphere. The tractor, which is the central focus of the image, is heavily laden with freshly plowed soil, indicating recent harvesting activity. \n\nThe tractor is robust and features large, deep-tread tires, which are ideal for navigating the uneven terrain of the field. The front of the tractor has a large, prominent grille and a large front bumper, adding to its sturdy appearance. The side of the tractor is painted red, which contrasts sharply with the earthy tones of the field and the surrounding environment.\n\nIn the background, there is a small group of people working alongside the tractor. They appear to be in the process of plowing or tilling the field, with one individual operating a small piece of agricultural equipment. The individuals are dressed in work attire, likely to protect themselves from the sun.\n\nBeyond the immediate field, a gentle slope of trees and hills can be seen, adding depth to the image and providing a sense of scale. The lighting and shadows create a dynamic and compelling visual effect, emphasizing the movement and activity of the tractor amidst the tranquil landscape.'], ['说中文', '这张图片展示了一辆正在田间作业的拖拉机。拖拉机正在地里犁地，尘土飞扬，显示出它正在努力工作。背景中可以看到一些树木和远处的山脉，天空呈现出柔和的橙黄色，可能是日出或日落时分的景象。'], ['你是谁', '我是一个人工智能助手，旨在帮助您回答问题、提供建议和解释。我并没有实体身体，因此无法与现实世界的人类互动。']]
66
- 2024-07-10 04:13:47 | INFO | stdout | question: 请识别图中所有的物体
67
- 2024-07-10 04:13:47 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EF820>]
68
- 2024-07-10 04:13:47 | INFO | model_worker | dynamic_image_size: True
69
- 2024-07-10 04:13:47 | INFO | model_worker | use_thumbnail: True
70
- 2024-07-10 04:13:47 | INFO | model_worker | Resize images to 448x448
71
- 2024-07-10 04:13:47 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
72
- 2024-07-10 04:13:47 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
73
- 2024-07-10 04:13:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
74
- 2024-07-10 04:13:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
75
- 2024-07-10 04:14:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
76
- 2024-07-10 04:14:18 | INFO | stdout | INFO: 10.140.60.209:50812 - "POST /worker_get_status HTTP/1.1" 200 OK
77
- 2024-07-10 04:14:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
78
- 2024-07-10 04:14:19 | INFO | stdout | INFO: 10.140.60.209:50818 - "POST /worker_generate_stream HTTP/1.1" 200 OK
79
- 2024-07-10 04:14:19 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', 'The image depicts a tractor plowing a field during what appears to be either sunrise or sunset. The sky is bathed in warm hues of orange and yellow, creating a dramatic and serene atmosphere. The tractor, which is the central focus of the image, is heavily laden with freshly plowed soil, indicating recent harvesting activity. \n\nThe tractor is robust and features large, deep-tread tires, which are ideal for navigating the uneven terrain of the field. The front of the tractor has a large, prominent grille and a large front bumper, adding to its sturdy appearance. The side of the tractor is painted red, which contrasts sharply with the earthy tones of the field and the surrounding environment.\n\nIn the background, there is a small group of people working alongside the tractor. They appear to be in the process of plowing or tilling the field, with one individual operating a small piece of agricultural equipment. The individuals are dressed in work attire, likely to protect themselves from the sun.\n\nBeyond the immediate field, a gentle slope of trees and hills can be seen, adding depth to the image and providing a sense of scale. The lighting and shadows create a dynamic and compelling visual effect, emphasizing the movement and activity of the tractor amidst the tranquil landscape.'], ['说中文', '这张图片展示了一辆正在田间作业的拖拉机。拖拉机正在地里犁地，尘土飞扬，显示出它正在努力工作。背景中可以看到一些树木��远处的山脉，天空呈现出柔和的橙黄色，可能是日出或日落时分的景象。'], ['你是谁', '我是一个人工智能助手，旨在帮助您回答问题、提供建议和解释。我并没有实体身体，因此无法与现实世界的人类互动。'], ['请识别图中所有的物体', '图中有以下物体：\n1. 一台拖拉机\n2. 一位农民\n3. 一辆装有犁的拖拉机\n4. 一片农田\n5. 一片水域\n6. 一片树林\n7. 一片天空']]
80
- 2024-07-10 04:14:19 | INFO | stdout | question: 你是谁
81
- 2024-07-10 04:14:19 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EDB70>]
82
- 2024-07-10 04:14:19 | INFO | model_worker | dynamic_image_size: True
83
- 2024-07-10 04:14:19 | INFO | model_worker | use_thumbnail: True
84
- 2024-07-10 04:14:19 | INFO | model_worker | Resize images to 448x448
85
- 2024-07-10 04:14:19 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
86
- 2024-07-10 04:14:19 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
87
- 2024-07-10 04:14:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
88
- 2024-07-10 04:14:27 | INFO | stdout | INFO: 10.140.60.209:50822 - "POST /worker_get_status HTTP/1.1" 200 OK
89
- 2024-07-10 04:14:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 6
90
- 2024-07-10 04:14:28 | INFO | stdout | INFO: 10.140.60.209:50828 - "POST /worker_generate_stream HTTP/1.1" 200 OK
91
- 2024-07-10 04:14:28 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', 'The image depicts a tractor plowing a field during what appears to be either sunrise or sunset. The sky is bathed in warm hues of orange and yellow, creating a dramatic and serene atmosphere. The tractor, which is the central focus of the image, is heavily laden with freshly plowed soil, indicating recent harvesting activity. \n\nThe tractor is robust and features large, deep-tread tires, which are ideal for navigating the uneven terrain of the field. The front of the tractor has a large, prominent grille and a large front bumper, adding to its sturdy appearance. The side of the tractor is painted red, which contrasts sharply with the earthy tones of the field and the surrounding environment.\n\nIn the background, there is a small group of people working alongside the tractor. They appear to be in the process of plowing or tilling the field, with one individual operating a small piece of agricultural equipment. The individuals are dressed in work attire, likely to protect themselves from the sun.\n\nBeyond the immediate field, a gentle slope of trees and hills can be seen, adding depth to the image and providing a sense of scale. The lighting and shadows create a dynamic and compelling visual effect, emphasizing the movement and activity of the tractor amidst the tranquil landscape.'], ['说中文', '这张图片展示了一辆正在田间作业的拖拉机。拖拉机正在地里犁地，尘土飞扬，显示出它正在努力工作。背景中可以看到一些树木和远处的山脉，天空呈现出柔和的橙黄色，可能是日出或日落时分的景象。'], ['你是谁', '我是一个人工智能助手，旨在帮助您回答问题、提供建议和解释。我并没有实体身体，因此无法与现实世界的人类互动。'], ['请识别图中所有的物体', '图中有以下物体：\n1. 一台拖拉机\n2. 一位农民\n3. 一辆装有犁的拖拉机\n4. 一片农田\n5. 一片水域\n6. 一片树林\n7. 一片天空'], ['你是谁', '我是一個人工智能助手，不是真實的人。如果你有其他問題或需要幫助，請隨時告訴我。']]
92
- 2024-07-10 04:14:28 | INFO | stdout | question: 请写一首诗
93
- 2024-07-10 04:14:28 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EE950>]
94
- 2024-07-10 04:14:28 | INFO | model_worker | dynamic_image_size: True
95
- 2024-07-10 04:14:28 | INFO | model_worker | use_thumbnail: True
96
- 2024-07-10 04:14:28 | INFO | model_worker | Resize images to 448x448
97
- 2024-07-10 04:14:28 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
98
- 2024-07-10 04:14:28 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
99
- 2024-07-10 04:14:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 6
100
- 2024-07-10 04:14:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
101
- 2024-07-10 04:14:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
102
- 2024-07-10 04:14:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
103
- 2024-07-10 04:15:08 | INFO | stdout | INFO: 10.140.60.209:50844 - "POST /worker_get_status HTTP/1.1" 200 OK
104
- 2024-07-10 04:15:10 | INFO | stdout | INFO: 10.140.60.209:50850 - "POST /worker_get_status HTTP/1.1" 200 OK
105
- 2024-07-10 04:15:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
106
- 2024-07-10 04:15:11 | INFO | stdout | INFO: 10.140.60.209:50856 - "POST /worker_generate_stream HTTP/1.1" 200 OK
107
- 2024-07-10 04:15:11 | INFO | stdout | history: []
108
- 2024-07-10 04:15:11 | INFO | stdout | question: Image-1: <image>
109
- 2024-07-10 04:15:11 | INFO | stdout | Describe this image in detail.
110
- 2024-07-10 04:15:11 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EE110>]
111
- 2024-07-10 04:15:11 | INFO | model_worker | dynamic_image_size: True
112
- 2024-07-10 04:15:11 | INFO | model_worker | use_thumbnail: True
113
- 2024-07-10 04:15:11 | INFO | model_worker | Resize images to 448x448
114
- 2024-07-10 04:15:11 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
115
- 2024-07-10 04:15:11 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
116
- 2024-07-10 04:15:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
117
- 2024-07-10 04:15:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
118
- 2024-07-10 04:15:19 | INFO | stdout | INFO: 10.140.60.209:50996 - "POST /worker_get_status HTTP/1.1" 200 OK
119
- 2024-07-10 04:15:24 | INFO | stdout | INFO: 10.140.60.209:51002 - "POST /worker_get_status HTTP/1.1" 200 OK
120
- 2024-07-10 04:15:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
121
- 2024-07-10 04:15:24 | INFO | stdout | INFO: 10.140.60.209:51008 - "POST /worker_generate_stream HTTP/1.1" 200 OK
122
- 2024-07-10 04:15:24 | INFO | stdout | history: []
123
- 2024-07-10 04:15:24 | INFO | stdout | question: Image-1: <image>
124
- 2024-07-10 04:15:24 | INFO | stdout | Describe this image in detail.
125
- 2024-07-10 04:15:24 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EDCF0>]
126
- 2024-07-10 04:15:24 | INFO | model_worker | dynamic_image_size: True
127
- 2024-07-10 04:15:24 | INFO | model_worker | use_thumbnail: True
128
- 2024-07-10 04:15:24 | INFO | model_worker | Resize images to 448x448
129
- 2024-07-10 04:15:24 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
130
- 2024-07-10 04:15:25 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
131
- 2024-07-10 04:15:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
132
- 2024-07-10 04:15:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
133
- 2024-07-10 04:15:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
134
- 2024-07-10 04:16:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
135
- 2024-07-10 04:16:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
136
- 2024-07-10 04:16:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
137
- 2024-07-10 04:16:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
138
- 2024-07-10 04:16:47 | INFO | stdout | INFO: 10.140.60.209:51172 - "POST /worker_get_status HTTP/1.1" 200 OK
139
- 2024-07-10 04:16:51 | INFO | stdout | INFO: 10.140.60.209:51180 - "POST /worker_get_status HTTP/1.1" 200 OK
140
- 2024-07-10 04:16:52 | INFO | stdout | INFO: 10.140.60.209:51186 - "POST /worker_get_status HTTP/1.1" 200 OK
141
- 2024-07-10 04:16:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
142
- 2024-07-10 04:16:53 | INFO | stdout | INFO: 10.140.60.209:51192 - "POST /worker_generate_stream HTTP/1.1" 200 OK
143
- 2024-07-10 04:16:53 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image is a beautifully captured close-up shot of a young dog, likely a Corgi, in a lush, natural setting. The dog is positioned in the center of the frame, looking directly at the camera with a soft, inquisitive expression. The background is a soft blur of various shades of green, suggesting a field or meadow filled with wildflowers and delicate grass. The flowers, predominantly in shades of pink and white, add a touch of color and softness to the image.\n\nThe dog itself has a distinctive black and white coat, with a fluffy and well-groomed appearance. Its fur is predominantly black, with white patches around its eyes, ears, and on its chest. The ears are perked up, indicating attentiveness and curiosity, and the dog's eyes are a striking blue, adding a sense of depth and life to the image.\n\nThe lighting in the image is soft and diffused, creating a gentle and serene atmosphere. The background is slightly out of focus, which helps to emphasize the dog and the flowers in the foreground. The overall mood of the image is one of tranquility and natural beauty, capturing the innocence and joy of childhood.\n\nThis image is a perfect representation of the joy and purity of nature, highlighting the beauty of the dog and the delicate beauty of the surrounding flora."]]
144
- 2024-07-10 04:16:53 | INFO | stdout | question: Image-2: <image>
145
- 2024-07-10 04:16:53 | INFO | stdout | 这是啥
146
- 2024-07-10 04:16:53 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F69B07A8580>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1039 at 0x7F69B07A92D0>]
147
- 2024-07-10 04:16:53 | INFO | model_worker | dynamic_image_size: True
148
- 2024-07-10 04:16:53 | INFO | model_worker | use_thumbnail: True
149
- 2024-07-10 04:16:53 | INFO | model_worker | Resize images to 448x448
150
- 2024-07-10 04:16:53 | INFO | model_worker | Split images to torch.Size([17, 3, 448, 448])
151
- 2024-07-10 04:16:53 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
152
- 2024-07-10 04:16:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
153
- 2024-07-10 04:17:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
154
- 2024-07-10 04:17:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
155
- 2024-07-10 04:17:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
156
- 2024-07-10 04:17:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
157
- 2024-07-10 04:18:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
158
- 2024-07-10 04:18:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
159
- 2024-07-10 04:18:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
160
- 2024-07-10 04:18:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
161
- 2024-07-10 04:19:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
162
- 2024-07-10 04:19:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
163
- 2024-07-10 04:19:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
164
- 2024-07-10 04:19:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
165
- 2024-07-10 04:20:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
166
- 2024-07-10 04:20:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
167
- 2024-07-10 04:20:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
168
- 2024-07-10 04:20:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
169
- 2024-07-10 04:20:54 | INFO | stdout | INFO: 10.140.60.209:51808 - "POST /worker_get_status HTTP/1.1" 200 OK
170
- 2024-07-10 04:20:56 | INFO | stdout | INFO: 10.140.60.209:51814 - "POST /worker_get_status HTTP/1.1" 200 OK
171
- 2024-07-10 04:20:57 | INFO | stdout | INFO: 10.140.60.209:51820 - "POST /worker_get_status HTTP/1.1" 200 OK
172
- 2024-07-10 04:20:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
173
- 2024-07-10 04:20:58 | INFO | stdout | INFO: 10.140.60.209:51826 - "POST /worker_generate_stream HTTP/1.1" 200 OK
174
- 2024-07-10 04:20:58 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image is a beautifully captured close-up shot of a young dog, likely a Corgi, in a lush, natural setting. The dog is positioned in the center of the frame, looking directly at the camera with a soft, inquisitive expression. The background is a soft blur of various shades of green, suggesting a field or meadow filled with wildflowers and delicate grass. The flowers, predominantly in shades of pink and white, add a touch of color and softness to the image.\n\nThe dog itself has a distinctive black and white coat, with a fluffy and well-groomed appearance. Its fur is predominantly black, with white patches around its eyes, ears, and on its chest. The ears are perked up, indicating attentiveness and curiosity, and the dog's eyes are a striking blue, adding a sense of depth and life to the image.\n\nThe lighting in the image is soft and diffused, creating a gentle and serene atmosphere. The background is slightly out of focus, which helps to emphasize the dog and the flowers in the foreground. The overall mood of the image is one of tranquility and natural beauty, capturing the innocence and joy of childhood.\n\nThis image is a perfect representation of the joy and purity of nature, highlighting the beauty of the dog and the delicate beauty of the surrounding flora."], ['Image-2: <image>\n这是啥', '这是一张以风和日丽为主题的图片。图片中是一只小狗在草地上奔跑的场景，背景是一片柔和的自然风景。图片上有一些文字，主要是书法风格的汉字。这些文字包括“江山万里心，风雨一杯酒”和“独真弟正之，于右任”。图片的左下角有“五”字，可能是这本书或画册的编号。']]
175
- 2024-07-10 04:20:58 | INFO | stdout | question: Image-3: <image>
176
- 2024-07-10 04:20:58 | INFO | stdout | 这是什么
177
- 2024-07-10 04:20:58 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F69B07A9630>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1039 at 0x7F69B07A8070>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=889x500 at 0x7F69B07A8430>]
178
- 2024-07-10 04:20:58 | INFO | model_worker | dynamic_image_size: True
179
- 2024-07-10 04:20:58 | INFO | model_worker | use_thumbnail: True
180
- 2024-07-10 04:20:58 | INFO | model_worker | Resize images to 448x448
181
- 2024-07-10 04:20:58 | INFO | model_worker | Split images to torch.Size([20, 3, 448, 448])
182
- 2024-07-10 04:20:58 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
183
- 2024-07-10 04:21:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
184
- 2024-07-10 04:21:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
185
- 2024-07-10 04:21:08 | INFO | stdout | INFO: 10.140.60.209:51834 - "POST /worker_get_status HTTP/1.1" 200 OK
186
- 2024-07-10 04:21:09 | INFO | stdout | INFO: 10.140.60.209:51842 - "POST /worker_get_status HTTP/1.1" 200 OK
187
- 2024-07-10 04:21:10 | INFO | stdout | INFO: 10.140.60.209:51848 - "POST /worker_get_status HTTP/1.1" 200 OK
188
- 2024-07-10 04:21:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 11
189
- 2024-07-10 04:21:11 | INFO | stdout | INFO: 10.140.60.209:51854 - "POST /worker_generate_stream HTTP/1.1" 200 OK
190
- 2024-07-10 04:21:11 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image is a beautifully captured close-up shot of a young dog, likely a Corgi, in a lush, natural setting. The dog is positioned in the center of the frame, looking directly at the camera with a soft, inquisitive expression. The background is a soft blur of various shades of green, suggesting a field or meadow filled with wildflowers and delicate grass. The flowers, predominantly in shades of pink and white, add a touch of color and softness to the image.\n\nThe dog itself has a distinctive black and white coat, with a fluffy and well-groomed appearance. Its fur is predominantly black, with white patches around its eyes, ears, and on its chest. The ears are perked up, indicating attentiveness and curiosity, and the dog's eyes are a striking blue, adding a sense of depth and life to the image.\n\nThe lighting in the image is soft and diffused, creating a gentle and serene atmosphere. The background is slightly out of focus, which helps to emphasize the dog and the flowers in the foreground. The overall mood of the image is one of tranquility and natural beauty, capturing the innocence and joy of childhood.\n\nThis image is a perfect representation of the joy and purity of nature, highlighting the beauty of the dog and the delicate beauty of the surrounding flora."], ['Image-2: <image>\n这是啥', '这是一张以风和日丽为主题的图片。图片中是一只小狗在草地上奔跑的场景，背景是一片柔和的自然风景。图片上有一些文字，主要是书法风格的汉字。这些文字包括“江山万里心，风雨一杯酒”和“独真弟正之，于右任”。图片的左下角有“五”字，可能是这本书或画册的编号。'], ['Image-3: <image>\n这是什么', '这是一张展示四只猎犬的图片。它们站在一片草地上，背景是干枯的麦穗。每只猎犬都有独特的斑纹，看起来很可爱。猎犬们戴着黑色的项圈，表情各异，有的看向镜头，有的看向远方。这是一张非常温馨和自然的图片，可能是在一个公园或自然保护区拍摄的。']]
191
- 2024-07-10 04:21:11 | INFO | stdout | question: Image-4: <image>
192
- 2024-07-10 04:21:11 | INFO | stdout | 这个呢
193
- 2024-07-10 04:21:11 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F69B07AA2F0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1039 at 0x7F69B07AA0E0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=889x500 at 0x7F69B07A9300>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=800x800 at 0x7F69B07A9540>]
194
- 2024-07-10 04:21:11 | INFO | model_worker | dynamic_image_size: True
195
- 2024-07-10 04:21:11 | INFO | model_worker | use_thumbnail: True
196
- 2024-07-10 04:21:11 | INFO | model_worker | Resize images to 448x448
197
- 2024-07-10 04:21:11 | INFO | model_worker | Split images to torch.Size([25, 3, 448, 448])
198
- 2024-07-10 04:21:12 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
199
- 2024-07-10 04:21:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
200
- 2024-07-10 04:21:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
201
- 2024-07-10 04:21:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
202
- 2024-07-10 04:21:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
203
- 2024-07-10 04:22:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
204
- 2024-07-10 04:22:14 | INFO | stdout | INFO: 10.140.60.209:52088 - "POST /worker_get_status HTTP/1.1" 200 OK
205
- 2024-07-10 04:22:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
206
- 2024-07-10 04:22:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 12
207
- 2024-07-10 04:22:15 | INFO | stdout | INFO: 10.140.60.209:52138 - "POST /worker_generate_stream HTTP/1.1" 200 OK
208
- 2024-07-10 04:22:15 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image is a beautifully captured close-up shot of a young dog, likely a Corgi, in a lush, natural setting. The dog is positioned in the center of the frame, looking directly at the camera with a soft, inquisitive expression. The background is a soft blur of various shades of green, suggesting a field or meadow filled with wildflowers and delicate grass. The flowers, predominantly in shades of pink and white, add a touch of color and softness to the image.\n\nThe dog itself has a distinctive black and white coat, with a fluffy and well-groomed appearance. Its fur is predominantly black, with white patches around its eyes, ears, and on its chest. The ears are perked up, indicating attentiveness and curiosity, and the dog's eyes are a striking blue, adding a sense of depth and life to the image.\n\nThe lighting in the image is soft and diffused, creating a gentle and serene atmosphere. The background is slightly out of focus, which helps to emphasize the dog and the flowers in the foreground. The overall mood of the image is one of tranquility and natural beauty, capturing the innocence and joy of childhood.\n\nThis image is a perfect representation of the joy and purity of nature, highlighting the beauty of the dog and the delicate beauty of the surrounding flora."], ['Image-2: <image>\n这是啥', '这是一张以风和日丽为主题的图片。图片中是一只小狗在草地上奔跑的场景，背景是一片柔和的自然风景。图片上有一些文字，主要是书法风格的汉字。这些文字包括“江山万里心，风雨一杯酒”和“独真弟正之，于右任”。图片的左下角有“五”字，可能是这本书或画册的编号。'], ['Image-3: <image>\n这是什么', '这是一张展示四只猎犬的图片。它们站在一片草地上，背景是干枯的麦穗。每只猎犬都有独特的斑纹，看起来很可爱。猎犬们戴着黑色的项圈，表情各异，有的看向镜头，有的看向远方。这是一张非常温馨和自然的图片，可能是在一个公园或自然保护区拍摄的。'], ['Image-4: <image>\n这个呢', '这个图片展示了一位穿着传统服饰的男子在篝火旁，背景是壮丽的自然风光，可能是在进行露营或者野外探险。图片的标题是“呼吸之野”，作者是许嵩，专辑名为《Vacs 8th Album》。图片中的场景充满了宁静与自然的美感，给人以放松和愉悦的感觉。']]
209
- 2024-07-10 04:22:15 | INFO | stdout | question: 识别图中的文字
210
- 2024-07-10 04:22:15 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EE050>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1039 at 0x7F699C3EFF10>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=889x500 at 0x7F699C3EF6D0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=800x800 at 0x7F699C3EFB80>]
211
- 2024-07-10 04:22:15 | INFO | model_worker | dynamic_image_size: True
212
- 2024-07-10 04:22:15 | INFO | model_worker | use_thumbnail: True
213
- 2024-07-10 04:22:15 | INFO | model_worker | Resize images to 448x448
214
- 2024-07-10 04:22:15 | INFO | model_worker | Split images to torch.Size([25, 3, 448, 448])
215
- 2024-07-10 04:22:16 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
216
- 2024-07-10 04:22:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
217
- 2024-07-10 04:22:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
218
- 2024-07-10 04:22:32 | INFO | stdout | INFO: 10.140.60.209:52212 - "POST /worker_get_status HTTP/1.1" 200 OK
219
- 2024-07-10 04:22:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 13
220
- 2024-07-10 04:22:34 | INFO | stdout | INFO: 10.140.60.209:52218 - "POST /worker_generate_stream HTTP/1.1" 200 OK
221
- 2024-07-10 04:22:34 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image is a beautifully captured close-up shot of a young dog, likely a Corgi, in a lush, natural setting. The dog is positioned in the center of the frame, looking directly at the camera with a soft, inquisitive expression. The background is a soft blur of various shades of green, suggesting a field or meadow filled with wildflowers and delicate grass. The flowers, predominantly in shades of pink and white, add a touch of color and softness to the image.\n\nThe dog itself has a distinctive black and white coat, with a fluffy and well-groomed appearance. Its fur is predominantly black, with white patches around its eyes, ears, and on its chest. The ears are perked up, indicating attentiveness and curiosity, and the dog's eyes are a striking blue, adding a sense of depth and life to the image.\n\nThe lighting in the image is soft and diffused, creating a gentle and serene atmosphere. The background is slightly out of focus, which helps to emphasize the dog and the flowers in the foreground. The overall mood of the image is one of tranquility and natural beauty, capturing the innocence and joy of childhood.\n\nThis image is a perfect representation of the joy and purity of nature, highlighting the beauty of the dog and the delicate beauty of the surrounding flora."], ['Image-2: <image>\n这是啥', '这是一张以风和日丽为主题的图片。图片中是一只小狗在草地上奔跑的场景，背景是一片柔和的自然风景。图片上有一些文字，主要是书法风格的汉字。这些文字包括“江山万里心，风雨一杯酒”和“独真弟正之，于右任”。图片的左下角有“五”字，可能是这本书或画册的编号。'], ['Image-3: <image>\n这是什么', '这是一张展示四只猎犬的图片。它们站在一片草地上，背景是干枯的麦穗。每只猎犬都有独特的斑纹，看起来很可爱。猎犬们戴着黑色的项圈，表情各异，有的看向镜头，有的看向远方。这是一张非常温馨和自然的图片，可能是在一个公园或自然保护区拍摄的。'], ['Image-4: <image>\n这个呢', '这个图片展示了一位穿着传统服饰的男子在篝火旁，背景是壮丽的自然风光，可能是在进行露营或者野外探险。图片的标题是“呼吸之野”，作者是许嵩，专辑名为《Vacs 8th Album》。图片中的场景充满了宁静与自然的美感，给人以放松和愉悦的感觉。'], ['识别图中的文字', "图中的文字是：\n\n呼吸之野\n许嵩\nVacs's 8th Album"]]
222
- 2024-07-10 04:22:34 | INFO | stdout | question: 总共给你了几张图片？
223
- 2024-07-10 04:22:34 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F699C3EE8C0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1039 at 0x7F699C3EF460>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=889x500 at 0x7F699C3EE260>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=800x800 at 0x7F699C3EEDA0>]
224
- 2024-07-10 04:22:34 | INFO | model_worker | dynamic_image_size: True
225
- 2024-07-10 04:22:34 | INFO | model_worker | use_thumbnail: True
226
- 2024-07-10 04:22:34 | INFO | model_worker | Resize images to 448x448
227
- 2024-07-10 04:22:34 | INFO | model_worker | Split images to torch.Size([25, 3, 448, 448])
228
- 2024-07-10 04:22:34 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
229
- 2024-07-10 04:22:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
230
- 2024-07-10 04:22:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
231
- 2024-07-10 04:23:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
232
- 2024-07-10 04:23:05 | INFO | stdout | INFO: 10.140.60.209:52232 - "POST /worker_get_status HTTP/1.1" 200 OK
233
- 2024-07-10 04:23:10 | INFO | stdout | INFO: 10.140.60.209:52240 - "POST /worker_get_status HTTP/1.1" 200 OK
234
- 2024-07-10 04:23:12 | INFO | stdout | INFO: 10.140.60.209:52262 - "POST /worker_get_status HTTP/1.1" 200 OK
235
- 2024-07-10 04:23:12 | INFO | stdout | INFO: 10.140.60.209:52276 - "POST /worker_get_status HTTP/1.1" 200 OK
236
- 2024-07-10 04:23:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 14
237
- 2024-07-10 04:23:13 | INFO | stdout | INFO: 10.140.60.209:52292 - "POST /worker_generate_stream HTTP/1.1" 200 OK
238
- 2024-07-10 04:23:13 | INFO | stdout | history: []
239
- 2024-07-10 04:23:13 | INFO | stdout | question: Image-1: <image>
240
- 2024-07-10 04:23:13 | INFO | stdout | 这是啥
241
- 2024-07-10 04:23:13 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F699C3ED480>]
242
- 2024-07-10 04:23:13 | INFO | model_worker | dynamic_image_size: True
243
- 2024-07-10 04:23:13 | INFO | model_worker | use_thumbnail: True
244
- 2024-07-10 04:23:13 | INFO | model_worker | Resize images to 448x448
245
- 2024-07-10 04:23:13 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
246
- 2024-07-10 04:23:13 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
247
- 2024-07-10 04:23:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 14
248
- 2024-07-10 04:23:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
249
- 2024-07-10 04:23:29 | INFO | stdout | INFO: 10.140.60.209:52404 - "POST /worker_get_status HTTP/1.1" 200 OK
250
- 2024-07-10 04:23:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 15
251
- 2024-07-10 04:23:30 | INFO | stdout | INFO: 10.140.60.209:52410 - "POST /worker_generate_stream HTTP/1.1" 200 OK
252
- 2024-07-10 04:23:30 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一幅汉字书法图片，展示的是一个汉字。汉字是中文的一种文字，属于表意文字，主要用于交流和记录语言。在图片中，可以看到一个黑色的汉字“零”，其上方有“七八”两个字。\n\n这个汉字“零”字在古代汉语中通常用来表示零散、零星、零乱等意思。在现代汉语中，这个字也可以用来表示“零散”或“零星”等含义。因此，这个汉字可能在一些特定语境中被用作零散、零乱、零散、零乱等意思的代称。\n\n整体来看，这幅图片展示了汉字“零”字的书写形式，同时也反映了汉字在现代汉语中的应用。']]
253
- 2024-07-10 04:23:30 | INFO | stdout | question: 识别文字
254
- 2024-07-10 04:23:30 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F699C3EFBB0>]
255
- 2024-07-10 04:23:30 | INFO | model_worker | dynamic_image_size: True
256
- 2024-07-10 04:23:30 | INFO | model_worker | use_thumbnail: True
257
- 2024-07-10 04:23:30 | INFO | model_worker | Resize images to 448x448
258
- 2024-07-10 04:23:30 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
259
- 2024-07-10 04:23:30 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
260
- 2024-07-10 04:23:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 15
261
- 2024-07-10 04:23:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
262
- 2024-07-10 04:23:36 | INFO | stdout | INFO: 10.140.60.209:52416 - "POST /worker_get_status HTTP/1.1" 200 OK
263
- 2024-07-10 04:23:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 16
264
- 2024-07-10 04:23:36 | INFO | stdout | INFO: 10.140.60.209:52422 - "POST /worker_generate_stream HTTP/1.1" 200 OK
265
- 2024-07-10 04:23:36 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一幅汉字书法图片，展示的是一个汉字。汉字是中文的一种文字，属于表意文字，主要用于交流和记录语言。在图片中，可以看到一个黑色的汉字“零”，其上方有“七八”两个字。\n\n这个汉字“零”字在古代汉语中通常用来表示零散、零星、零乱等意思。在现代汉语中，这个字也可以用来表示“零散”或“零星”等含义。因此，这个汉字可能在一些特定语境中被用作零散、零乱、零散、零乱等意思的代称。\n\n整体来看，这幅图片展示了汉字“零”字的书写形式，同时也反映了汉字在现代汉语中的应用。'], ['识别文字', '图中所有文字为：\n\n零七八碎\n']]
266
- 2024-07-10 04:23:36 | INFO | stdout | question: 这个成语是什么意思
267
- 2024-07-10 04:23:36 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F699C3EFC10>]
268
- 2024-07-10 04:23:36 | INFO | model_worker | dynamic_image_size: True
269
- 2024-07-10 04:23:36 | INFO | model_worker | use_thumbnail: True
270
- 2024-07-10 04:23:36 | INFO | model_worker | Resize images to 448x448
271
- 2024-07-10 04:23:36 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
272
- 2024-07-10 04:23:36 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
273
- 2024-07-10 04:23:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
274
- 2024-07-10 04:23:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
275
- 2024-07-10 04:24:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
276
- 2024-07-10 04:24:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
277
- 2024-07-10 04:24:19 | INFO | stdout | INFO: 10.140.60.209:52588 - "POST /worker_get_status HTTP/1.1" 200 OK
278
- 2024-07-10 04:24:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 17
279
- 2024-07-10 04:24:20 | INFO | stdout | INFO: 10.140.60.209:52594 - "POST /worker_generate_stream HTTP/1.1" 200 OK
280
- 2024-07-10 04:24:20 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一幅汉字书法图片，展示的是一个汉字。汉字是中文的一种文字，属于表意文字，主要用于交流和记录语言。在图片中，可以看到一个黑色的汉字“零”，其上方有“七八”两个字。\n\n这个汉字“零”字在古代汉语中通常用来表示零散、零星、零乱等意思。在现代汉语中，这个字也可以用来表示“零散”或“零星”等含义。因此，这个汉字可能在一些特定语境中被用作零散、零乱、零散、零乱等意思的代称。\n\n整体来看，这幅图片展示了汉字“零”字的书写形式，同时也反映了汉字在现代汉语中的应用。'], ['识别文字', '图中所有文字为：\n\n零七八碎\n'], ['这个成语是什么意思', '这个成语是“零七八碎”，意思是形容事物不完整或残缺不全。']]
281
- 2024-07-10 04:24:20 | INFO | stdout | question: 详细一点
282
- 2024-07-10 04:24:20 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F699C3EDF00>]
283
- 2024-07-10 04:24:20 | INFO | model_worker | dynamic_image_size: True
284
- 2024-07-10 04:24:20 | INFO | model_worker | use_thumbnail: True
285
- 2024-07-10 04:24:20 | INFO | model_worker | Resize images to 448x448
286
- 2024-07-10 04:24:20 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
287
- 2024-07-10 04:24:20 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
288
- 2024-07-10 04:24:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
289
- 2024-07-10 04:24:27 | INFO | stdout | INFO: 10.140.60.209:52610 - "POST /worker_get_status HTTP/1.1" 200 OK
290
- 2024-07-10 04:24:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
291
- 2024-07-10 04:24:33 | INFO | stdout | INFO: 10.140.60.209:52618 - "POST /worker_get_status HTTP/1.1" 200 OK
292
- 2024-07-10 04:24:33 | INFO | stdout | INFO: 10.140.60.209:52624 - "POST /worker_get_status HTTP/1.1" 200 OK
293
- 2024-07-10 04:24:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 18
294
- 2024-07-10 04:24:33 | INFO | stdout | INFO: 10.140.60.209:52630 - "POST /worker_generate_stream HTTP/1.1" 200 OK
295
- 2024-07-10 04:24:33 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一幅汉字书法图片，展示的是一个汉字。汉字是中文的一种文字，属于表意文字，主要用于交流和记录语言。在图片中，可以看到一个黑色的汉字“零”，其上方有“七八”两个字。\n\n这个汉字“零”字在古代汉语中通常用来表示零散、零星、零乱等意思。在现代汉语中，这个字也可以用来表示“零散”或“零星”等含义。因此，这个汉字可能在一些特定语境中被用作零散、零乱、零散、零乱等意思的代称。\n\n整体来看，这幅图片展示了汉字“零”字的书写形式，同时也反映了汉字在现代汉语中的应用。'], ['识别文字', '图中���有文字为：\n\n零七八碎\n'], ['这个成语是什么意思', '这个成语是“零七八碎”，意思是形容事物不完整或残缺不全。'], ['详细一点', '这幅图中的汉字是“零七八碎”。']]
296
- 2024-07-10 04:24:33 | INFO | stdout | question: Image-2: <image>
297
- 2024-07-10 04:24:33 | INFO | stdout | 图中有几只狗？
298
- 2024-07-10 04:24:33 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F69B07AA410>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=889x500 at 0x7F69B07AA7A0>]
299
- 2024-07-10 04:24:33 | INFO | model_worker | dynamic_image_size: True
300
- 2024-07-10 04:24:33 | INFO | model_worker | use_thumbnail: True
301
- 2024-07-10 04:24:34 | INFO | model_worker | Resize images to 448x448
302
- 2024-07-10 04:24:34 | INFO | model_worker | Split images to torch.Size([8, 3, 448, 448])
303
- 2024-07-10 04:24:34 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
304
- 2024-07-10 04:24:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
305
- 2024-07-10 04:24:40 | INFO | stdout | INFO: 10.140.60.209:52640 - "POST /worker_get_status HTTP/1.1" 200 OK
306
- 2024-07-10 04:24:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
307
- 2024-07-10 04:24:48 | INFO | stdout | INFO: 10.140.60.209:52646 - "POST /worker_get_status HTTP/1.1" 200 OK
308
- 2024-07-10 04:24:49 | INFO | stdout | INFO: 10.140.60.209:52654 - "POST /worker_get_status HTTP/1.1" 200 OK
309
- 2024-07-10 04:24:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 19
310
- 2024-07-10 04:24:52 | INFO | stdout | INFO: 10.140.60.209:52664 - "POST /worker_generate_stream HTTP/1.1" 200 OK
311
- 2024-07-10 04:24:52 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一幅汉字书法图片，展示的是一个汉字。汉字是中文的一种文字，属于表意文字，主要用于交流和记录语言。在图片中，可以看到一个黑色的汉字“零”，其上方有“七八”两个字。\n\n这个汉字“零”字在古代汉语中通常用来表示零散、零星、零乱等意思。在现代汉语中，这个字也可以用来表示“零散”或“零星”等含义。因此，这个汉字可能在一些特定语境中被用作零散、零乱、零散、零乱等意思的代称。\n\n整体来看，这幅图片展示了汉字“零”字的书写形式，同时也反映了汉字在现代汉语中的应用。'], ['识别文字', '图中所有文字为：\n\n零七八碎\n'], ['这个成语是什么意思', '这个成语是“零七八碎”，意思是形容事物不完整或残缺不全。'], ['详细一点', '这幅图中的汉字是“零七八碎”。'], ['Image-2: <image>\n图中有几只狗？', '图中有五只狗。']]
312
- 2024-07-10 04:24:52 | INFO | stdout | question: Image-3: <image>
313
- 2024-07-10 04:24:52 | INFO | stdout | 请识别图中的所有物体，并输出检测框
314
- 2024-07-10 04:24:52 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F69B07A9270>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=889x500 at 0x7F69B07A9D80>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7F69B07AA0B0>]
315
- 2024-07-10 04:24:52 | INFO | model_worker | dynamic_image_size: True
316
- 2024-07-10 04:24:52 | INFO | model_worker | use_thumbnail: True
317
- 2024-07-10 04:24:54 | INFO | model_worker | Resize images to 448x448
318
- 2024-07-10 04:24:54 | INFO | model_worker | Split images to torch.Size([15, 3, 448, 448])
319
- 2024-07-10 04:24:54 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
320
- 2024-07-10 04:25:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 19
321
- 2024-07-10 04:25:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
322
- 2024-07-10 04:25:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
323
- 2024-07-10 04:25:24 | INFO | stdout | INFO: 10.140.60.209:52812 - "POST /worker_get_status HTTP/1.1" 200 OK
324
- 2024-07-10 04:25:28 | INFO | stdout | INFO: 10.140.60.209:52820 - "POST /worker_get_status HTTP/1.1" 200 OK
325
- 2024-07-10 04:25:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 20
326
- 2024-07-10 04:25:28 | INFO | stdout | INFO: 10.140.60.209:52828 - "POST /worker_generate_stream HTTP/1.1" 200 OK
327
- 2024-07-10 04:25:28 | INFO | stdout | history: []
328
- 2024-07-10 04:25:28 | INFO | stdout | question: Image-1: <image>
329
- 2024-07-10 04:25:28 | INFO | stdout | Describe this image in detail.
330
- 2024-07-10 04:25:28 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F69B07A9360>]
331
- 2024-07-10 04:25:28 | INFO | model_worker | dynamic_image_size: True
332
- 2024-07-10 04:25:28 | INFO | model_worker | use_thumbnail: True
333
- 2024-07-10 04:25:28 | INFO | model_worker | Resize images to 448x448
334
- 2024-07-10 04:25:28 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
335
- 2024-07-10 04:25:28 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
336
- 2024-07-10 04:25:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 20
337
- 2024-07-10 04:25:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
338
- 2024-07-10 04:25:43 | INFO | stdout | INFO: 10.140.60.209:52836 - "POST /worker_get_status HTTP/1.1" 200 OK
339
- 2024-07-10 04:25:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 21
340
- 2024-07-10 04:25:43 | INFO | stdout | INFO: 10.140.60.209:52842 - "POST /worker_generate_stream HTTP/1.1" 200 OK
341
- 2024-07-10 04:25:43 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', 'The image depicts three cheetahs, likely young cubs, sitting closely together on a grassy savanna. The background is a soft, blurred golden field, suggesting a sunset or sunrise, with the light casting a warm glow over the scene. The cheetahs are well-defined, showcasing their characteristic spots and markings that are typical of the species. The largest cheetah stands prominently in the center, its gaze directed slightly to the side, giving an impression of alertness or contemplation. The second and third cheetahs are positioned slightly behind and to the sides of the first, maintaining a close and familial bond. The fur of the cheetahs is a mix of light brown and black, with the spots providing a stark contrast against the dark fur. The image captures the majesty and elegance of these magnificent animals in their natural habitat, highlighting their beauty and intelligence.']]
342
- 2024-07-10 04:25:43 | INFO | stdout | question: 帮我画一幅类似的画
343
- 2024-07-10 04:25:43 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F69B07A8A00>]
344
- 2024-07-10 04:25:43 | INFO | model_worker | dynamic_image_size: True
345
- 2024-07-10 04:25:43 | INFO | model_worker | use_thumbnail: True
346
- 2024-07-10 04:25:43 | INFO | model_worker | Resize images to 448x448
347
- 2024-07-10 04:25:43 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
348
- 2024-07-10 04:25:44 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
349
- 2024-07-10 04:25:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 21
350
- 2024-07-10 04:25:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
351
- 2024-07-10 04:25:55 | INFO | stdout | INFO: 10.140.60.209:52848 - "POST /worker_get_status HTTP/1.1" 200 OK
352
- 2024-07-10 04:26:00 | INFO | stdout | INFO: 10.140.60.209:52856 - "POST /worker_get_status HTTP/1.1" 200 OK
353
- 2024-07-10 04:26:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
354
- 2024-07-10 04:26:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 22
355
- 2024-07-10 04:26:01 | INFO | stdout | INFO: 10.140.60.209:52862 - "POST /worker_generate_stream HTTP/1.1" 200 OK
356
- 2024-07-10 04:26:01 | INFO | stdout | history: []
357
- 2024-07-10 04:26:01 | INFO | stdout | question: Image-1: <image>
358
- 2024-07-10 04:26:01 | INFO | stdout | Describe this image in detail.
359
- 2024-07-10 04:26:01 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F69B07AB190>]
360
- 2024-07-10 04:26:01 | INFO | model_worker | dynamic_image_size: True
361
- 2024-07-10 04:26:01 | INFO | model_worker | use_thumbnail: True
362
- 2024-07-10 04:26:01 | INFO | model_worker | Resize images to 448x448
363
- 2024-07-10 04:26:01 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
364
- 2024-07-10 04:26:01 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
365
- 2024-07-10 04:26:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
366
- 2024-07-10 04:26:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
367
- 2024-07-10 04:26:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
368
- 2024-07-10 04:26:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
369
- 2024-07-10 04:27:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
370
- 2024-07-10 04:27:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
371
- 2024-07-10 04:27:28 | INFO | stdout | INFO: 10.140.60.209:53158 - "POST /worker_get_status HTTP/1.1" 200 OK
372
- 2024-07-10 04:27:30 | INFO | stdout | INFO: 10.140.60.209:53164 - "POST /worker_get_status HTTP/1.1" 200 OK
373
- 2024-07-10 04:27:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 23
374
- 2024-07-10 04:27:30 | INFO | stdout | INFO: 10.140.60.209:53170 - "POST /worker_generate_stream HTTP/1.1" 200 OK
375
- 2024-07-10 04:27:30 | INFO | stdout | history: []
376
- 2024-07-10 04:27:30 | INFO | stdout | question: hello
377
- 2024-07-10 04:27:30 | INFO | stdout | pil_images: []
378
- 2024-07-10 04:27:30 | INFO | stdout | Caught Unknown Error local variable 'pixel_values' referenced before assignment
379
- 2024-07-10 04:27:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
380
- 2024-07-10 04:27:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
381
- 2024-07-10 04:27:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
382
- 2024-07-10 04:28:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
383
- 2024-07-10 04:28:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
384
- 2024-07-10 04:28:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
385
- 2024-07-10 04:28:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
386
- 2024-07-10 04:29:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23