Uploaded model

  • Developed by: saksornr
  • License: apache-2.0
  • Finetuned from model : SeaLLMs/SeaLLM-7B-v2.5

Pre-quantized for faster loading. (~17 GB to 5 GB)

Downloads last month
17
Safetensors
Model size
4.78B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The HF Inference API does not support text-generation models for transformers accelerate bitsandbytes library.

Model tree for saksornr/SeaLLM-7B-v2.5-4bit

Quantized
(15)
this model
Finetunes
1 model