| license: apache-2.0 | |
| language: | |
| - ja | |
| - en | |
| base_model: | |
| - cyberagent/Mistral-Nemo-Japanese-Instruct-2408 | |
| tags: | |
| - gptq | |
| FP8-Dynamic (Linear layers, PTQ activations) quant of [cyberagent/Mistral-Nemo-Japanese-Instruct-2408](https://huggingface.co/cyberagent/Mistral-Nemo-Japanese-Instruct-2408) w/ [LLM Compressor](https://github.com/vllm-project/llm-compressor) 0.4.0 |