Efficient Online Transfer Learning for 3D Object Classification in Autonomous Driving

We are actively updating this repository (especially removing hard code and adding comments) to make it easy to use. If you have any questions, please open an issue. Thanks!

This is a ROS-based efficient online learning framework for object classification in 3D LiDAR scans, taking advantage of robust multi-target tracking to avoid the need for data annotation by a human expert. The system is only tested in Ubuntu 18.04 and ROS Melodic (compilation fails on Ubuntu 20.04 and ROS Noetic).

Please watch the videos below for more details.

NEWS

[2023-01-11] Our evaluation results in KITTI 3D OBJECT DETECTION are ranked 276, 91, 125 in car, pedestrian and cyclist respectively.

3D Object Detection

CAR

PEDESTRIAN

CYCLIST

[2023-01-11] Our evaluation results in KITTI 2D OBJECT DETECTION achieved rankings of 22 on pedestrian and 66 on cyclist!

2D Object Detection

CAR

PEDESTRIAN

CYCLIST

Install & Build

Please read the readme file of each sub-package first and install the corresponding dependencies.

Run

1. Prepare dataset

• (Optional) Download the raw data from KITTI.

• (Optional) Download the sample data for testing.

• (Optional) Prepare a customized dataset according to the format of the sample data.

2. Manual set specific path parameters

 # launch/efficient_online_learning
 # autoware_tracker/config/params.yaml

3. Run the project

cd catkin_ws
source devel/setup.bash
roslaunch src/efficient_online_learning/launch/efficient_online_learning.launch

Citation

If you are considering using this code, please reference the following:

@article{yangr23sensors,
author = {Rui Yang and Zhi Yan and Tao Yang and Yaonan Wang and Yassine Ruichek},
title = {Efficient Online Transfer Learning for Road Participants Detection in Autonomous Driving},
journal = {IEEE Sensors Journal},
volume = {23},
number = {19},
Pages = {23522--23535},
year = {2023}
}

@inproceedings{yangr21itsc,
title={Efficient online transfer learning for 3D object classification in autonomous driving},
author={Rui Yang and Zhi Yan and Tao Yang and Yassine Ruichek},
booktitle = {Proceedings of the 2021 IEEE International Conference on Intelligent Transportation Systems (ITSC)},
pages = {2950--2957},
address = {Indianapolis, USA},
month = {September},
year = {2021}
}