ISTA-DASLab
/

Llama-2-70b-AQLM-4Bit-2x16-hf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

No model card

Downloads last month: 24

Safetensors

Model size

18.2B params

Tensor type

F32

·

I16

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Collection including ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf

AQLM

AQLM quantized LLMs • 20 items • Updated Dec 18, 2024 • 46