ColPali
Safetensors
English
qwen2_vl
vidore-exclude

Cuda OOM

#2
by AndreaCD2302 - opened

I've been trying to embed some images with the exact same code and exact same images as last week and everything was working well. Now, when running the code, L4 or even A100 GPU are out of memory as it seems it needs more than 70Gb when processing the image embeddings.

Does someone knows how to solve it?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment