File size: 459 Bytes
0dc97dd
 
 
 
 
 
 
 
 
 
 
dd0dc0c
1
2
3
4
5
6
7
8
9
10
11
12
13
---
license: apache-2.0
language:
- ja
- en
base_model:
- cyberagent/Mistral-Nemo-Japanese-Instruct-2408
tags:
- gptq
---

W4A16 gs128 GPTQ quant of [cyberagent/Mistral-Nemo-Japanese-Instruct-2408](https://huggingface.co/cyberagent/Mistral-Nemo-Japanese-Instruct-2408) w/ [GPTQModel](https://github.com/ModelCloud/GPTQModel) 1.7.2 using [augmxnt/ultra-orca-boros-en-ja-v1](https://huggingface.co/datasets/augmxnt/ultra-orca-boros-en-ja-v1) as calibration set