Uploaded model

Developed by: saksornr
License: apache-2.0
Finetuned from model : SeaLLMs/SeaLLM-7B-v2.5

Pre-quantized for faster loading. (~17 GB to 5 GB)

Downloads last month: 17

Safetensors

Model size

4.78B params

Tensor type

F32

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The HF Inference API does not support text-generation models for transformers accelerate bitsandbytes library.

Model tree for saksornr/SeaLLM-7B-v2.5-4bit

Base model

SeaLLMs/SeaLLM-7B-v2.5

Quantized

(15)

this model

Finetunes

1 model