Hugging Face's logo

shisa-ai
/
Mistral-Nemo-Japanese-Instruct-2408-GPTQ-W4A16-gs128

Safetensors
Japanese
English
mistral
gptq
4-bit precision
Model card Files Community
leonardlin commited on
Commit
dd0dc0c
·
verified ·
1 Parent(s): 0dc97dd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -9,4 +9,4 @@ tags:
9
  - gptq
10
  ---
11
 
12
- W4A16 gs128 GPTQ quant w/ [GPTQModel](https://github.com/ModelCloud/GPTQModel) 1.7.2 using [augmxnt/ultra-orca-boros-en-ja-v1](https://huggingface.co/datasets/augmxnt/ultra-orca-boros-en-ja-v1) as calibration set
 
9
  - gptq
10
  ---
11
 
12
+ W4A16 gs128 GPTQ quant of [cyberagent/Mistral-Nemo-Japanese-Instruct-2408](https://huggingface.co/cyberagent/Mistral-Nemo-Japanese-Instruct-2408) w/ [GPTQModel](https://github.com/ModelCloud/GPTQModel) 1.7.2 using [augmxnt/ultra-orca-boros-en-ja-v1](https://huggingface.co/datasets/augmxnt/ultra-orca-boros-en-ja-v1) as calibration set