Hugging Face's logo

cosmo3769
/
starcoderbase-3b-GPTQ

Text Generation
Transformers
gpt_bigcode
4-bit precision
gptq
Model card Files Community
cosmo3769 commited on
Commit
348e709
·
verified ·
1 Parent(s): d126142

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  # starcoderbase-3b-GPTQ
2
 
3
- Quantized starcoderbase-3b model to GPTQ format (4-bit precision).
4
 
5
  [Quantization script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/quantize-starcodebase-3b-gptq.ipynb)
6
 
 
1
  # starcoderbase-3b-GPTQ
2
 
3
+ Quantized starcoderbase-3b model to GPTQ format (4-bit precision) using [Auto-GPTQ](https://github.com/AutoGPTQ/AutoGPTQ).
4
 
5
  [Quantization script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/quantize-starcodebase-3b-gptq.ipynb)
6