Please add following backends for the GPTQ models.

#1
by SaffalPoosh - opened

GPTQ is also supported using following backend apis:

  • exllama v2
  • Transformers
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment