Low bit version issues
#7
by
Jilt
- opened
I tried low bit versions using bnb, but having issues making it work, could be a bug in infer.py
See github comment: https://github.com/Ola-Omni/Ola/issues/2#issuecomment-2688126751
Hi, as we have not tested our model in low-bit settings, you may follow the error instructions to solve the issue.