Hugging Face's logo

catalpa
/
codecapybara-4bit-128g-gptq

Text Generation
Transformers
llama
Inference Endpoints
Model card Files Community
1
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Based on https://huggingface.co/Fsoft-AIC/CodeCapybara

Using https://github.com/qwopqwop200/GPTQ-for-LLaMa triton branch

python llama.py CodeCapybara/ c4 --wbits 4 --true-sequential --act-order --groupsize 128 --save_safetensors codecapybara-4bit-128g-gptq.safetensors

Downloads last month
10
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.