Sign Language Recognition via Skeleton Aware Multi-modal Ensemble

By Songyao Jiang, Bin Sun, Lichen Wang, Yue Bai, Kunpeng Li and Yun Fu.

Smile Lab @ Northeastern University

This work SAM-SLR-v2 is an improved version of SAM-SLR.

This repo is under construction, will be released in Oct. 2021

News

[2021/10/20] The source code, and pretrained models and preprocessed data for SL-GCN are released.

[2021/10/14] The preprint version of SAM-SLR-v2 paper is available on Arxiv.

Citation

If you find this project useful in your research, please cite our paper

% SAM-SLR-v2
@article{jiang2021sign,
  title={Sign Language Recognition via Skeleton-Aware Multi-Model Ensemble},
  author={Jiang, Songyao and Sun, Bin and Wang, Lichen and Bai, Yue and Li, Kunpeng and Fu, Yun},
  journal={arXiv preprint arXiv:2110.06161},
  year={2021}
}

% SAM-SLR
@inproceedings{jiang2021skeleton,
  title={Skeleton Aware Multi-modal Sign Language Recognition},
  author={Jiang, Songyao and Sun, Bin and Wang, Lichen and Bai, Yue and Li, Kunpeng and Fu, Yun},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
  year={2021}
}