Skip to content

Latest commit

 

History

History
24 lines (23 loc) · 1.3 KB

README.md

File metadata and controls

24 lines (23 loc) · 1.3 KB
Raw

HGTMT

PyTorch implementation of "Heterogeneous Graph Transformer for Multiple Tiny Object Tracking in RGB-T Videos", IEEE Transactions on MultiMedia. Feel free to contact me (xuqingyu@nudt.edu.cn) if any questions. Please star the repository~~

Dataset: VT-Tiny-MOT

  • Download the dataset from Baidu Drive (Key: VTMT) and unzip them to ./data

Note:

  • The multiple tiny object tracking dataset is composed of two modalities: visible and thermal, and is well aligned.

Code:

  • Create the working environment through environment.yml
  • Download the transformer pvtv2 backbone from PVTv2.
  • Run training/main_RGBT-Tiny_graph_gnnloss.py for training.
  • Run tracking/RGBT-Tiny_private_graph_Track2_crossmodal.py for tracking.

Acknowledgement:

Cite:

@article{xu2024heterogeneous,
  title={Heterogeneous Graph Transformer for Multiple Tiny Object Tracking in RGB-T Videos},
  author={Xu, Qingyu and Wang, Longguang and Sheng, Weidong and Wang, Yingqian and Xiao, Chao and Ma, Chao and An, Wei},
  journal={IEEE Transactions on Multimedia},
  year={2024},
  publisher={IEEE}
}