Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
python client ai server offline rockchip client-server ia orangepi orange-pi npu llm rk3588 orangepi5 llm-inference llm-apps rk3576 orangepi5pro npu-llm
-
Updated
Mar 24, 2025 - Python