Now that this is quantized, what are the memory requirements?

by salamanders - opened 7 days ago

7 days ago

With this being quantized to int4, how much GPU memory is required to run the demo? (I tried and failed on a 1080ti with 11GB so I assume it is more than that)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment