TinyLlama v1.0 Chat for RK3588
This is a conversion from https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0 to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Latest update: 11th May 2024. Converted with RKLLM runtime 1.0.1.
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM, in this case Apache 2.0:
https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
- Downloads last month
- 25
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support