runtime error

Exit code: 1. Reason: INFO:colqwen-api:Loading ColQwen2 model... Downloading shards: 0%| | 0/2 [00:00<?, ?it/s] Downloading shards: 50%|█████ | 1/2 [00:09<00:09, 9.05s/it] Downloading shards: 100%|██████████| 2/2 [00:15<00:00, 7.72s/it] Downloading shards: 100%|██████████| 2/2 [00:15<00:00, 7.92s/it] `Qwen2VLRotaryEmbedding` can now be fully parameterized by passing the model config through the `config` argument. All other arguments will be removed in v4.46 Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 50%|█████ | 1/2 [00:01<00:01, 1.53s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.29s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.32s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 15, in <module> model = ColQwen2.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4310, in from_pretrained model.load_adapter( File "/usr/local/lib/python3.10/site-packages/transformers/integrations/peft.py", line 251, in load_adapter self._dispatch_accelerate_model( File "/usr/local/lib/python3.10/site-packages/transformers/integrations/peft.py", line 498, in _dispatch_accelerate_model dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 377, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: model.layers.22, model.layers.23, model.layers.24, model.layers.25, model.layers.26, model.layers.27, model.norm, model.rotary_emb, custom_text_proj.

Container logs: