TheBloke
/

Mistral-7B-Instruct-v0.1-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Update README.md

#7 opened over 1 year ago by

Inference Speed Compared to ExLlama?

#6 opened over 1 year ago by

32g Version

#5 opened over 1 year ago by

How to use this AWQ model from Python code gives an error.

#4 opened over 1 year ago by

AWQ models with transformer pipeline

#3 opened almost 2 years ago by

Prompt for RAG

#2 opened almost 2 years ago by