CATFace: Cross-Attribute-Guided Transformer with Self-Attention Distillation for Low-Quality Face Recognition
Not on the map. Why?
Abstract (arXiv)
Although face recognition (FR) has achieved great success in recent years, it is still challenging to accurately recognize faces in low-quality images due to the obscured facial details. Nevertheless, it is often feasible to make predictions about specific soft biometric (SB) attributes, such as gender, and baldness even in dealing with low-quality images. In this paper, we propose a novel multi-branch neural network that leverages SB attribute information to boost the performance of FR. To this end, we propose a cross-attribute-guided transformer fusion (CATF) module that effectively captures the long-range dependencies and relationships between FR and SB feature representations. The synergy created by the reciprocal flow of information in the dual cross-attention operations of the proposed CATF module enhances the performance of FR. Furthermore, we introduce a novel self-attention distillation framework that effectively highlights crucial facial regions, such as landmarks by aligning low-quality images with those of their high-quality counterparts in the feature space. The proposed self-attention distillation regularizes our network to learn a unified quality-invariant feature representation in unconstrained environments. We conduct extensive experiments on various FR benchmarks varying in quality. Experimental results demonstrate the superiority of our FR method compared to state-of-the-art FR studies.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 59 of its 100 references that are in the map. First posted on arXiv 5 Jan 2024.
Builds on
59 of 100 references.
References · 59
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2014Going Deeper with Convolutionscited by 4,231
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
38 more
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2019Relational Knowledge Distillationcited by 873
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2014Learning Face Representation from Scratchcited by 451
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
- 2021MagFace: A Universal Representation for Face Recognition and Quality Assessmentcited by 332
- 2015WIDER FACE: A Face Detection Benchmarkcited by 297
- 2016Large-Margin Softmax Loss for Convolutional Neural Networkscited by 296
- 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
- 2021Incorporating Convolution Designs into Visual Transformerscited by 248
- 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
- 2021WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognitioncited by 221
- 2016Coupled Generative Adversarial Networkscited by 216
- 2020Regularizing Class-wise Predictions via Self-knowledge Distillationcited by 144
- 2021ElasticFace: Elastic Margin Loss for Deep Face Recognitioncited by 143
- 2016HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognitioncited by 103
- 2020Towards Universal Representation Learning for Deep Face Recognitioncited by 78
- 2018Low-Resolution Face Recognitioncited by 64
- 2019Mis-classified Vector Guided Softmax Loss for Face Recognitioncited by 60
- 2018Low-resolution Face Recognition in the Wild via Selective Knowledge Distillationcited by 55
- 2019Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentationcited by 55
- 2017Towards Large-Pose Face Frontalization in the Wildcited by 50
- 2018ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributescited by 50
- 2021Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transformcited by 50
- 2021Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillationcited by 46
- 2016An All-In-One Convolutional Neural Network for Face Analysiscited by 45
- 2021Face Transformer for Recognitioncited by 45
- 2022Cross-Architecture Knowledge Distillationcited by 40
- 2016MOON: A Mixed Objective Optimization Network for the Recognition of Facial Attributescited by 34
- 2021When Age-Invariant Face Recognition Meets Face Age Synthesis: A Multi-Task Learning Frameworkcited by 29
- 2020Deep Multi-task Multi-label CNN for Effective Facial Attribute Classificationcited by 22
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.