| license: cc-by-nc-sa-4.0 | |
| language: | |
| - ja | |
| - zh | |
| - ko | |
| base_model: | |
| - CjangCjengh/GaLLM-14B-v0.1 | |
| [GaLLM-14B-v0.1](https://huggingface.co/CjangCjengh/GaLLM-14B-v0.1)的GPTQ-Int4量化版，使用方法相同 | |
| 推荐使用vllm部署，然后使用OpenAI格式的API访问： | |
| ```sh | |
| vllm serve CjangCjengh/GaLLM-14B-v0.1-GPTQ-Int4 --port <your_port> | |
| ``` | |