leonardlin's picture
Create README.md
77d35db verified
metadata
license: apache-2.0
language:
  - ja
  - en
base_model:
  - cyberagent/Mistral-Nemo-Japanese-Instruct-2408
tags:
  - gptq

FP8-Dynamic (Linear layers, PTQ activations) quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ LLM Compressor 0.4.0