gguf is here made available by Backyard AI

first try finetuning gemma 9b instruct. my data was a mess, i only noticed that after training, so this is just a test run

i formatted the dataset like below

<start_of_turn>user
{system}

{prompt}<end_of_turn>
<start_of_turn>model
{response}<end_of_turn>
<start_of_turn>user
{prompt}<end_of_turn>
<start_of_turn>model
{response}<end_of_turn>

and so on...

settings for st: context/instruct

Downloads last month
12
Safetensors
Model size
9.24B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for Hastagaras/Gemmoy-9B-MK.I

Quantizations
3 models