Hugging Face's logo

shisa-ai
/
Mistral-Nemo-Japanese-Instruct-FP8-Dynamic

Safetensors
Japanese
English
mistral
gptq
compressed-tensors
Model card Files Community
leonardlin commited on
Commit
77d35db
·
verified ·
1 Parent(s): 3ca0c65

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - ja
5
+ - en
6
+ base_model:
7
+ - cyberagent/Mistral-Nemo-Japanese-Instruct-2408
8
+ tags:
9
+ - gptq
10
+ ---
11
+
12
+ FP8-Dynamic (Linear layers, PTQ activations) quant of [cyberagent/Mistral-Nemo-Japanese-Instruct-2408](https://huggingface.co/cyberagent/Mistral-Nemo-Japanese-Instruct-2408) w/ [LLM Compressor](https://github.com/vllm-project/llm-compressor) 0.4.0