solidrust
/

LLama-3.1-8B-Matrix-AWQ

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions

LLama-3.1-8B-Matrix-AWQ / README.md

Commit History

Update README after successful quantization

5c0ad60
verified

Suparious commited on Sep 19, 2024

Add processing notice

31cbe43
verified

Suparious commited on Sep 19, 2024