Minimal GPU requirements

by tmk12 - opened Oct 6, 2024

tmk12

Oct 6, 2024

What is a minimal vram to run the model?

Javed7

Oct 8, 2024

Around 140GB

tmk12

Oct 9, 2024

Thanks!

tmk12 changed discussion status to closed Oct 9, 2024

imoc

Dec 24, 2024

•

Actually, 6 bits is already very good. 54GB + some cache headroom.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment