RedHatAI
/

Qwen2-7B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Qwen2-7B-Instruct-quantized.w4a16

Ctrl+K

Ctrl+K

2 contributors

History: 9 commits

abhinavnmagic's picture

Upload tokenizer_config.json with huggingface_hub

5fded11 verified about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
added_tokens.json

80 Bytes

Upload added_tokens.json with huggingface_hub about 1 year ago
config.json

1.03 kB

Upload config.json with huggingface_hub about 1 year ago
merges.txt

1.67 MB

Upload merges.txt with huggingface_hub about 1 year ago
model.safetensors

5.58 GB
xet

Upload model.safetensors with huggingface_hub about 1 year ago
quantize_config.json

269 Bytes

Upload quantize_config.json with huggingface_hub about 1 year ago
special_tokens_map.json

367 Bytes

Upload special_tokens_map.json with huggingface_hub about 1 year ago
tokenizer.json

7.03 MB

Upload tokenizer.json with huggingface_hub about 1 year ago
tokenizer_config.json

1.3 kB

Upload tokenizer_config.json with huggingface_hub about 1 year ago