Rombos-LLM-70b-Llama-3.3 AWQ 4-Bit Quantized

This repository provides the AWQ 4-bit quantized version of rombodawg/Rombos-LLM-70b-Llama-3.3, originally developed by Meta AI and finetuned by rombodawg.

Downloads last month
23
Safetensors
Model size
11.3B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for kosbu/Rombos-LLM-70b-Llama-3.3-AWQ