Can this run on 24 GB VRAM?

#3
by JLouisBiz - opened

I have tried running it on 24 GB VRAM straight this application, but it says there is not enough memory. Is there any way to make it right?

ByteDance org

We are trying to reduce memory usage. Please consider following some tips at https://github.com/bytedance/InfiniteYou?#memory-requirements first.

Using it with ComfyUI apparently can be done with 24 GB VRAM in 46 seconds. Maybe you could apply same methods?

See: https://github.com/ZenAI-Vietnam/ComfyUI_InfiniteYou/issues/3

I just did not confirm it yet, as I am still trying to install the missing node.

ByteDance org

We have provided quantization and offloading options to reduce the memory requirements for our models. There are also some additional tips there. Thanks!

Thank you so much for this. I will go. I will try.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment