ATTN-FIQA: Interpretable Attention-based Face Image Quality Assessment with Vision Transformers
Not on the map. Why?
Abstract (arXiv)
Face Image Quality Assessment (FIQA) aims to assess the recognition utility of face samples and is essential for reliable face recognition (FR) systems. Existing approaches require computationally expensive procedures such as multiple forward passes, backpropagation, or additional training, and only recent work has focused on the use of Vision Transformers. Recent studies highlighted that these architectures inherently function as saliency learners with attention patterns naturally encoding spatial importance. This work proposes ATTN-FIQA, a novel training-free approach that investigates whether pre-softmax attention scores from pre-trained Vision Transformer-based face recognition models can serve as quality indicators. We hypothesize that attention magnitudes intrinsically encode quality: high-quality images with discriminative facial features enable strong query-key alignments producing focused, high-magnitude attention patterns, while degraded images generate diffuse, low-magnitude patterns. ATTN-FIQA extracts pre-softmax attention matrices from the final transformer block, aggregate multi-head attention information across all patches, and compute image-level quality scores through simple averaging, requiring only a single forward pass through pre-trained models without architectural modifications, backpropagation, or additional training. Through comprehensive evaluation across eight benchmark datasets and four FR models, this work demonstrates that attention-based quality scores effectively correlate with face image quality and provide spatial interpretability, revealing which facial regions contribute most to quality determination.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 60 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
35 of 60 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2022A ConvNet for the 2020scited by 3,545
- 2020Quantifying Attention Flow in Transformerscited by 759
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
- 2021MagFace: A Universal Representation for Face Recognition and Quality Assessmentcited by 332
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
- 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
23 more
- 2019Probabilistic Face Embeddingscited by 171
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
- 2021ElasticFace: Elastic Margin Loss for Deep Face Recognitioncited by 143
- 2020SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustnesscited by 111
- 2020Face Image Quality Assessment: A Literature Surveycited by 79
- 2021CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiabilitycited by 68
- 2021SDD-FIQA: Unsupervised Face Image Quality Assessment with Similarity Distribution Distancecited by 63
- 2019FaceQnet: Quality Assessment for Face Recognition based on Deep Learningcited by 61
- 2020Biometric Quality: Review and Application to Face Recognition with FaceQnetcited by 41
- 2022WebFace260M: A Benchmark for Million-Scale Deep Face Recognitioncited by 41
- 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 37
- 2021Cross-Quality LFW: A Database for Analyzing Cross-Resolution Image Face Recognition in Unconstrained Environmentscited by 33
- 2022ViT-CX: Causal Explanation of Vision Transformerscited by 27
- 2023DifFIQA: Face Image Quality Assessment Using Denoising Diffusion Probabilistic Modelscited by 22
- 2022FaceQAN: Face Image Quality Assessment Through Adversarial Noise Explorationcited by 17
- 2021Pixel-Level Face Image Quality Assessment for Explainable Face Recognitioncited by 14
- 2023Considerations on the Evaluation of Biometric Quality Assessment Algorithmscited by 14
- 2024GraFIQs: Face Image Quality Assessment Using Gradient Magnitudescited by 12
- 2025ViT-FIQA: Assessing Face Image Quality using Vision Transformerscited by 7
- 2025TRIQA: Image Quality Assessment by Contrastive Pretraining on Ordered Distortion Tripletscited by 4
- 2026ViTNT-FIQA: Training-Free Face Image Quality Assessment with Vision Transformerscited by 4
- 2025Attention IoU: Examining Biases in CelebA using Attention Mapscited by 3
- 2022Can Transformer Attention Spread Give Insights Into Uncertainty of Detected and Tracked Objects?cited by 1
Built on by
Not cited yet.