Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mistral-7B-Instruct-v0.3-GPTQ-4bit
like
18
Follow
Red Hat
714
Text Generation
Transformers
Safetensors
mistral
conversational
Eval Results
text-generation-inference
4-bit precision
gptq
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
dc49055
Mistral-7B-Instruct-v0.3-GPTQ-4bit
Ctrl+K
Ctrl+K
3 contributors
History:
8 commits
mgoin
Update README.md
dc49055
verified
11 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
README.md
1.71 kB
Update README.md
11 months ago
config.json
Safe
972 Bytes
Initial commit
11 months ago
model.safetensors
Safe
4.17 GB
LFS
Initial commit
11 months ago
nm-vllm_Llama_vs_Mistral.png
17.2 kB
add nm-vllm perf
11 months ago
quantize_config.json
Safe
269 Bytes
Initial commit
11 months ago
special_tokens_map.json
Safe
414 Bytes
Initial commit
11 months ago
tokenizer.json
Safe
1.96 MB
Initial commit
11 months ago
tokenizer.model
Safe
587 kB
LFS
Initial commit
11 months ago
tokenizer_config.json
Safe
137 kB
Initial commit
11 months ago