I would like to convert some omni models to 4 bits using bnb. I am getting deepcopy error when trying with naive approach. Can you share with me the script that used for conversion of fp16 to 4 bits?
· Sign up or log in to comment
