Llama-3 GPTQ Quantized Models - a astronomer Collection

astronomer 's Collections

Llama-3 GPTQ Quantized Models

Llama-3 Special Variants

Llama-3 GPTQ Quantized Models

updated Apr 21, 2024

A collection of Llama 3 models quantized by Astronomer

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22, 2024 • 218 • 25
astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 8.86k • 25
astronomer/Llama-3-8B-GPTQ-8-Bit

Text Generation • Updated Apr 22, 2024 • 51 • 2
astronomer/Llama-3-8B-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 41 • 6