StableLM-2-Zephyr-1.6B-GGUF

Original Model

stabilityai/stablelm-2-zephyr-1_6b

Run with Gaianet

Prompt template:

prompt template: llama-2-chat

Context size:

chat_ctx_size: 4096

Run with GaiaNet:

Downloads last month
258
GGUF
Model size
1.64B params
Architecture
stablelm

5-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for gaianet/stablelm-2-zephyr-1.6b-GGUF

Quantized
(14)
this model

Datasets used to train gaianet/stablelm-2-zephyr-1.6b-GGUF