Hugging Face's logo

jtatman
/
felladrin-tinymistral-248m-v4-dpo

Text Generation
Transformers
Safetensors
mistral
DPO
reasoning
conversational
text-generation-inference
Inference Endpoints
Model card Files Community

Model Card for felladrin-tinymistral-248m-v4-dpo

SFT model trained with orca DPO

Model Details

Model Description

Experimental.

ChatML format.

Downloads last month
93
Safetensors
Model size
248M params
Tensor type
F32
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train jtatman/felladrin-tinymistral-248m-v4-dpo