Jimmy1229
/

Llama-3.2-1B-8bit

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Llama-3.2-1B-8bit / quantize_config.json

Commit History

AutoGPTQ model for meta-llama/Llama-3.2-1B: 8 bits, gr128, desc_act=False

74464d9
verified

Jimmy1229 commited on Jan 18