Qwen
/

Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

it run on cpu only

#2

by rakmik - opened Jan 30

rakmik

Jan 30

https://github.com/werruww/GPTQ-Int4-cpu-only/blob/main/succ_GPTQ_Int4_cpu_only.ipynb

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment