Official Pytorch Implementation of the paper, "SwinFace: A Multi-task Transformer for Face Recognition, Facial Expression Recognition, Age Estimation and Face Attribute Estimation"（https://arxiv.org/pdf/2308.11509.pdf）
In recent years, vision transformers have been introduced into face recognition and analysis and have achieved performance breakthroughs.
However, most previous methods generally train a single model or an ensemble of models to perform the desired task, which ignores the synergy among different tasks and fails to achieve improved prediction accuracy, increased data efficiency, and reduced training time.
This paper presents a multi-purpose algorithm for simultaneous face recognition, facial expression recognition, age estimation, and face attribute estimation (40 attributes including gender) based on a single Swin Transformer.
Our design, the SwinFace, consists of a single shared backbone together with a subnet for each set of related tasks.
To address the conflicts among multiple tasks and meet the different demands of tasks, a Multi-Level Channel Attention (MLCA) module is integrated into each task-specific analysis subnet, which can adaptively select the features from optimal levels and channels to perform the desired tasks.
Extensive experiments show that the proposed model has a better understanding of the face and achieves excellent performance for all tasks.
Especially, it achieves 90.97% accuracy on RAF-DB and 0.22
Here are some test results. For detailed experimental information, please refer to our paper.
- Face Recognition
- Facial Expression Recognition
- Age Estimation
- Facial Attribute Estimation
The train.sh file provides the necessary commands for training the model.
The inference.py file provides an example of using SwinFace for inference.
The trained model file can be downloaded from the following link：
Google Drive：https://drive.google.com/drive/folders/1NjVN3Kp_Tmwt17hWCIWgHpuWzkHYaman?usp=sharing