VPTQ Llama 3.3 70B Instruct without finetune
Collection
arxiv.org/abs/2409.17066, VPTQ Llama 3.3 70B without finetune
•
6 items
•
Updated
Disclaimer:
The model is reproduced based on the paper VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models github and arXiv
The model itself is sourced from a community release.
It is intended only for experimental purposes.
Users are responsible for any consequences arising from the use of this model.
- Downloads last month
- 55
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for VPTQ-community/Meta-Llama-3.3-70B-Instruct-v16-k65536-65536-woft
Base model
meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.3-70B-Instruct