Update RK3562/RK3566/RK3568/RK3576/RK3588/RV1103B/RV1103/RV1106/RK211…

…8 NPU SDK to V2.1.0 Signed-off-by: Randall Zhuo <randall.zhuo@rock-chips.com>
airockchip · Aug 8, 2024 · deaba85 · deaba85
1 parent 77b7109
commit deaba85
Show file tree

Hide file tree

Showing 134 changed files with 2,646 additions and 808 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,5 +1,14 @@
 # CHANGELOG
 
+## v2.1.0
+
+- Support RV1103B (Beta)
+- Support RK2118 (Beta)
+- Support Flash Attention (Only RK3562 and RK3576)
+- Improve MatMul API
+- Improve support for int32 and int64
+- Support more operators and operator fusion
+
 ## v2.0.0-beta0
 
  - Support RK3576 (Beta)

diff --git a/LICENSE b/LICENSE
@@ -1,28 +1,5 @@
-// Copyright 2020 Rockchip Electronics Co.,Ltd.
-// All rights reserved.
-//
-// Redistribution and use in source and binary forms, with or without
-// modification, are permitted provided that the following conditions are met:
-//
-// 1. Redistributions of source code must retain the above copyright notice,
-// this list of conditions and the following disclaimer.
-//
-// 2. Redistributions in binary form must reproduce the above copyright notice,
-// this list of conditions and the following disclaimer in the documentation
-// and/or other materials provided with the distribution.
-//
-// 3. Neither the name of the copyright holder nor the names of its contributors
-// may be used to endorse or promote products derived from this software without
-// specific prior written permission.
-//
-// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
-// AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
-// IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
-// ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE
-// LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
-// CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
-// SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
-// INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
-// CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
-// ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
-// POSSIBILITY OF SUCH DAMAGE.
+**Copyright Statement**
+
+Copyright(C) 2024 Rockchip Electronics Co., Ltd. All rights reserved.
+
+BY OPENING OR USING THIS FILE, RECEIVER HEREBY ACKNOWLEDGES AND AGREES THAT THE SOFTWARE/FIRMWARE AND ITS DOCUMENTATIONS ("ROCKCHIP SOFTWARE") RECEIVED FROM ROCKCHIP ON AN "AS-IS" BASIS ONLY WITHOUT ANY AND ALL WARRANTIES, EITHER EXPRESS, IMPLIED OR STATUTORY, INCLUDING, WITHOUT LIMITATION, ANY WARRANTY OR CONDITION WITH RESPECT TO TITLE, MERCHANTABILITY, FITNESS FOR ANY PARTICULAR PURPOSE, OR NON-INFRINGEMENT. NEITHER DOES ROCKCHIP PROVIDE ANY WARRANTY WHATSOEVER WITH RESPECT TO ANY OPEN SOURCE TECHNOLOGIES, THIRD-PARTY TECHNOLOGIES OR ANY STANDARD TECHNOLOGIES WHICH MAY BE SUPPORTED BY, INCORPORATED IN, OR SUPPLIED WITH THE ROCKCHIP SOFTWARE. RECEIVER EXPRESSLY ACKNOWLEDGES THAT IT IS RECEIVER'S SOLE RESPONSIBILITY TO OBTAIN AND MAINTAIN ALL NECESSARY LICENSES AND RIGHTS FROM THEIR RESPECTIVE OWNERS TO USE ANY SUCH THIRD-PARTY TECHNOLOGIES OR ANY STANDARD TECHNOLOGIES. RECEIVER'S SOLE AND EXCLUSIVE REMEDY AND ROCKCHIP'S ENTIRE AND CUMULATIVE LIABILITY WITH RESPECT TO THE ROCKCHIP SOFTWARE RELEASED HEREUNDER WILL BE, AT ROCKCHIP 'S OPTION, TO REVISE OR REPLACE THE ROCKCHIP SOFTWARE AT ISSUE, OR REFUND ANY FEES OR CHARGE PAID BY RECEIVER TO ROCKCHIP FOR SUCH ROCKCHIP SOFTWARE AT ISSUE.
diff --git a/README.md b/README.md
@@ -16,11 +16,12 @@
 - RKNPU kernel driver is responsible for interacting with NPU hardware. It has been open source and can be found in the Rockchip kernel code.
 
 # Support Platform
-  - RK3566/RK3568 Series
   - RK3588 Series
   - RK3576 Series
+  - RK3566/RK3568 Series
   - RK3562 Series
   - RV1103/RV1106
+  - RV1103B
   - RK2118
 
 
@@ -45,7 +46,7 @@ Note:
   - Ubuntu 18.04 python 3.6/3.7
   - Ubuntu 20.04 python 3.8/3.9
   - Ubuntu 22.04 python 3.10/3.11
-- Latest version:v2.0.0-beta0
+- Latest version:v2.1.0
 
 
 
@@ -59,16 +60,13 @@ https://github.com/airockchip/rknn-llm
 
 # CHANGELOG
 
-## v2.0.0-beta0
- - Support RK3576 (Beta)
- - Support RK2118 (Beta)
- - Support SDPA (Scaled Dot Product Attention) to improve transformer performance
- - Improve custom operators support
- - Improve MatMul API
- - Improve support for Reshape,Transpose,BatchLayernorm,Softmax,Deconv,Matmul,ScatterND etc.
- - Support pytorch 2.1
- - Improve support for QAT models of pytorch and onnx
- - Optimize automatic generation of C++ code
+## v2.1.0
+ - Support RV1103B (Beta)
+- Support RK2118 (Beta)
+- Support Flash Attention (Only RK3562 and RK3576)
+- Improve MatMul API
+- Improve support for int32 and int64
+- Support more operators and operator fusion
 
  for older version, please refer [CHANGELOG](CHANGELOG.md)
 

diff --git a/doc/01_Rockchip_RK2118_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf b/doc/01_Rockchip_RK2118_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf
diff --git a/doc/01_Rockchip_RK2118_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf b/doc/01_Rockchip_RK2118_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf
diff --git a/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.0.0beta0_CN.pdf b/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.0.0beta0_CN.pdf
diff --git a/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.0.0beta0_EN.pdf b/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.0.0beta0_EN.pdf
diff --git a/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf b/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf
diff --git a/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf b/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf
diff --git a/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.0.0beta0_CN.pdf b/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.0.0beta0_CN.pdf
diff --git a/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.0.0beta0_EN.pdf b/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.0.0beta0_EN.pdf
diff --git a/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf b/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf
diff --git a/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf b/doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf
diff --git a/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_CN.pdf b/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_CN.pdf
diff --git a/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_EN.pdf b/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_EN.pdf
diff --git a/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.1.0_CN.pdf b/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.1.0_CN.pdf
diff --git a/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.1.0_EN.pdf b/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.1.0_EN.pdf
diff --git a/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.0.0beta0_CN.pdf b/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.0.0beta0_CN.pdf
diff --git a/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.0.0beta0_EN.pdf b/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.0.0beta0_EN.pdf
diff --git a/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.1.0_CN.pdf b/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.1.0_CN.pdf
diff --git a/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.1.0_EN.pdf b/doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.1.0_EN.pdf
diff --git a/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.0.0beta0_CN.pdf b/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.0.0beta0_CN.pdf
diff --git a/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.0.0beta0_EN.pdf b/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.0.0beta0_EN.pdf
diff --git a/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.1.0_CN.pdf b/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.1.0_CN.pdf
diff --git a/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.1.0_EN.pdf b/doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.1.0_EN.pdf
diff --git a/doc/05_RKNN_Compiler_Support_Operator_List_V2.1.0.pdf b/doc/05_RKNN_Compiler_Support_Operator_List_V2.1.0.pdf
diff --git a/doc/05_RKNN_Compiler_Support_Operator_List_v2.0.0beta0.pdf b/doc/05_RKNN_Compiler_Support_Operator_List_v2.0.0beta0.pdf