Gemma 2B IT for RK3588
This is a conversion from https://huggingface.co/google/gemma-2b-it to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Latest update: 11th May 2024. Converted with RKLLM runtime 1.0.1.
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
No license, same as the original repo
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.