Llama-3.3-70B-Instruct AWQ 4-Bit Quantized Version

This repository provides the AWQ 4-bit quantized version of meta-llama/Llama-3.3-70B-Instruct, originally developed by Meta AI.

Downloads last month
49,384
Safetensors
Model size
11.3B params
Tensor type
I32
ยท
FP16
ยท
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for kosbu/Llama-3.3-70B-Instruct-AWQ

Quantized
(88)
this model

Spaces using kosbu/Llama-3.3-70B-Instruct-AWQ 2