File size: 369 Bytes
ae7d72d 74b1a7b ae7d72d 74b1a7b 0392df9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: cc-by-nc-sa-4.0
language:
- ja
- zh
- ko
base_model:
- CjangCjengh/GaLLM-14B-v0.1
---
[GaLLM-14B-v0.1](https://huggingface.co/CjangCjengh/GaLLM-14B-v0.1)的GPTQ-Int4量化版，使用方法相同
推荐使用vllm部署，然后使用OpenAI格式的API访问：
```sh
vllm serve CjangCjengh/GaLLM-14B-v0.1-GPTQ-Int4 --port <your_port>
```
|