I think the amazing @TheBloke is going to convert them and push them as always to his repos! You can already use load_in_4bit = True for bitsandbytes quantization with transformers format
Your need to confirm your account before you can post a new comment.
