Qwen-chat-1_8B-rkllm
This is a conversion from Qwen-1_8B-Chat to the RKLLM format for chat in Rockchip devices.
Support Devices
- RK3588/RK3588s
Convert tools
To Converting LLMs for Rockchip's NPUs, please see the artical1,2 for model details.
Converted with RKLLM runtime
- RKLLM runtime
1.0.1
License
Same as the original Qwen-1_8B-Chat
Reference
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.