File size: 370 Bytes
77d35db |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: apache-2.0
language:
- ja
- en
base_model:
- cyberagent/Mistral-Nemo-Japanese-Instruct-2408
tags:
- gptq
---
FP8-Dynamic (Linear layers, PTQ activations) quant of [cyberagent/Mistral-Nemo-Japanese-Instruct-2408](https://huggingface.co/cyberagent/Mistral-Nemo-Japanese-Instruct-2408) w/ [LLM Compressor](https://github.com/vllm-project/llm-compressor) 0.4.0 |