relaxml
/

Llama-1-65b-E8PRVQ-3Bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

No model card

Downloads last month: 22

Safetensors

Model size

3.57B params

Tensor type

I64

·

FP16

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Collection including relaxml/Llama-1-65b-E8PRVQ-3Bit

QuIP# Quantized Models

https://github.com/Cornell-RelaxML/quip-sharp • 34 items • Updated Oct 5, 2024 • 1