This is a MLC converted weight from Dolphin3.0-Qwen2.5-0.5B model in MLC format q4f16_1.

The model can be used for projects MLC-LLM and WebLLM.

Downloads last month
7
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for huggingkot/Dolphin3.0-Qwen2.5-0.5B-q4f16_1-MLC

Base model

Qwen/Qwen2.5-0.5B
Quantized
(18)
this model

Collection including huggingkot/Dolphin3.0-Qwen2.5-0.5B-q4f16_1-MLC