Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

RedHatAI
/
Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation
Transformers
Safetensors
mistral
conversational
Eval Results
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions
xet
Community
2
Mistral-7B-Instruct-v0.3-GPTQ-4bit
Ctrl+K
Ctrl+K
  • 3 contributors
History: 6 commits
Eldar Kurtic
add nm-vllm perf
bc8ee38 about 1 year ago
  • .gitattributes
    1.52 kB
    initial commit about 1 year ago
  • README.md
    1.41 kB
    add nm-vllm perf about 1 year ago
  • config.json
    972 Bytes
    Initial commit about 1 year ago
  • model.safetensors
    4.17 GB
    xet
    Initial commit about 1 year ago
  • nm-vllm_Llama_vs_Mistral.png
    17.2 kB
    add nm-vllm perf about 1 year ago
  • quantize_config.json
    269 Bytes
    Initial commit about 1 year ago
  • special_tokens_map.json
    414 Bytes
    Initial commit about 1 year ago
  • tokenizer.json
    1.96 MB
    Initial commit about 1 year ago
  • tokenizer.model
    587 kB
    xet
    Initial commit about 1 year ago
  • tokenizer_config.json
    137 kB
    Initial commit about 1 year ago