mlsanityData to 7 Oct 2026

CATFace: Cross-Attribute-Guided Transformer with Self-Attention Distillation for Low-Quality Face Recognition

arXiv 2401.03037 ↗First posted 5 Jan 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Although face recognition (FR) has achieved great success in recent years, it is still challenging to accurately recognize faces in low-quality images due to the obscured facial details. Nevertheless, it is often feasible to make predictions about specific soft biometric (SB) attributes, such as gender, and baldness even in dealing with low-quality images. In this paper, we propose a novel multi-branch neural network that leverages SB attribute information to boost the performance of FR. To this end, we propose a cross-attribute-guided transformer fusion (CATF) module that effectively captures the long-range dependencies and relationships between FR and SB feature representations. The synergy created by the reciprocal flow of information in the dual cross-attention operations of the proposed CATF module enhances the performance of FR. Furthermore, we introduce a novel self-attention distillation framework that effectively highlights crucial facial regions, such as landmarks by aligning low-quality images with those of their high-quality counterparts in the feature space. The proposed self-attention distillation regularizes our network to learn a unified quality-invariant feature representation in unconstrained environments. We conduct extensive experiments on various FR benchmarks varying in quality. Experimental results demonstrate the superiority of our FR method compared to state-of-the-art FR studies.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 59 of its 100 references that are in the map. First posted on arXiv 5 Jan 2024.

Builds on

59 of 100 references.

References · 59

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  7. 2017Squeeze-and-Excitation Networkscited by 4,763
  8. 2014Going Deeper with Convolutionscited by 4,231
  9. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  10. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  11. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  12. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
38 more
  1. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  2. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  3. 2019Relational Knowledge Distillationcited by 873
  4. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  5. 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
  6. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
  7. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
  8. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
  9. 2014Learning Face Representation from Scratchcited by 451
  10. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  11. 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
  12. 2021MagFace: A Universal Representation for Face Recognition and Quality Assessmentcited by 332
  13. 2015WIDER FACE: A Face Detection Benchmarkcited by 297
  14. 2016Large-Margin Softmax Loss for Convolutional Neural Networkscited by 296
  15. 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
  16. 2021Incorporating Convolution Designs into Visual Transformerscited by 248
  17. 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
  18. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
  19. 2021WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognitioncited by 221
  20. 2016Coupled Generative Adversarial Networkscited by 216
  21. 2020Regularizing Class-wise Predictions via Self-knowledge Distillationcited by 144
  22. 2021ElasticFace: Elastic Margin Loss for Deep Face Recognitioncited by 143
  23. 2016HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognitioncited by 103
  24. 2020Towards Universal Representation Learning for Deep Face Recognitioncited by 78
  25. 2018Low-Resolution Face Recognitioncited by 64
  26. 2019Mis-classified Vector Guided Softmax Loss for Face Recognitioncited by 60
  27. 2018Low-resolution Face Recognition in the Wild via Selective Knowledge Distillationcited by 55
  28. 2019Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentationcited by 55
  29. 2017Towards Large-Pose Face Frontalization in the Wildcited by 50
  30. 2018ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributescited by 50
  31. 2021Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transformcited by 50
  32. 2021Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillationcited by 46
  33. 2016An All-In-One Convolutional Neural Network for Face Analysiscited by 45
  34. 2021Face Transformer for Recognitioncited by 45
  35. 2022Cross-Architecture Knowledge Distillationcited by 40
  36. 2016MOON: A Mixed Objective Optimization Network for the Recognition of Facial Attributescited by 34
  37. 2021When Age-Invariant Face Recognition Meets Face Age Synthesis: A Multi-Task Learning Frameworkcited by 29
  38. 2020Deep Multi-task Multi-label CNN for Effective Facial Attribute Classificationcited by 22

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.