imjliao's picture
Update quantized model to support tensor parallel
f335095 verified