--- license: apache-2.0 language: - ja - en base_model: - cyberagent/Mistral-Nemo-Japanese-Instruct-2408 tags: - gptq --- FP8-Dynamic (Linear layers, PTQ activations) quant of [cyberagent/Mistral-Nemo-Japanese-Instruct-2408](https://huggingface.co/cyberagent/Mistral-Nemo-Japanese-Instruct-2408) w/ [LLM Compressor](https://github.com/vllm-project/llm-compressor) 0.4.0