Efficient Face Image Quality Assessment via Self-training and Knowledge Distillation
On the map: Knowledge distillation → General knowledge distillation methods
Abstract (arXiv)
Face image quality assessment (FIQA) is essential for various face-related applications. Although FIQA has been extensively studied and achieved significant progress, the computational complexity of FIQA algorithms remains a key concern for ensuring scalability and practical deployment in real-world systems. In this paper, we aim to develop a computationally efficient FIQA method that can be easily deployed in real-world applications. Specifically, our method consists of two stages: training a powerful teacher model and distilling a lightweight student model from it. To build a strong teacher model, we adopt a self-training strategy to improve its capacity. We first train the teacher model using labeled face images, then use it to generate pseudo-labels for a set of unlabeled images. These pseudo-labeled samples are used in two ways: (1) to distill knowledge into the student model, and (2) to combine with the original labeled images to further enhance the teacher model through self-training. The enhanced teacher model is used to further pseudo-label another set of unlabeled images for distilling the student models. The student model is trained using a combination of labeled images, pseudo-labeled images from the original teacher model, and pseudo-labeled images from the enhanced teacher model. Experimental results demonstrate that our student model achieves comparable performance to the teacher model with an extremely low computational overhead. Moreover, our method achieved first place in the ICCV 2025 VQualA FIQA Challenge. The code is available at https://github.com/sunwei925/Efficient-FIQA.git.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation. Builds on 40 of its 69 references that are in the map. First posted on arXiv 21 Jul 2025.
Builds on
40 of 69 references.
References · 40
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2018Born Again Neural Networkscited by 546
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2019Billion-scale semi-supervised learning for image classificationcited by 232
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
28 more
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 225
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2022EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applicationscited by 121
- 2020SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustnesscited by 112
- 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 89
- 2020Face Image Quality Assessment: A Literature Surveycited by 80
- 2021Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Trainingcited by 71
- 2021SDD-FIQA: Unsupervised Face Image Quality Assessment with Similarity Distribution Distancecited by 64
- 2019FaceQnet: Quality Assessment for Face Recognition based on Deep Learningcited by 62
- 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2021Deep Learning based Full-reference and No-reference Quality Assessment Models for Compressed UGC Videoscited by 27
- 2023Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluationcited by 27
- 2024Large Multi-modality Model Assisted AI-Generated Image Quality Assessmentcited by 24
- 2022Going the Extra Mile in Face Image Quality Assessment: A Novel Database and Modelcited by 22
- 2024Enhancing Blind Video Quality Assessment with Rich Quality-aware Featurescited by 19
- 2024DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformercited by 17
- 2023An Image Quality Assessment Dataset for Portraitscited by 14
- 2024Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Modelcited by 13
- 2025FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessmentcited by 13
- 2025AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Imagescited by 13
- 2024Assessing UHD Image Quality from Aesthetics, Distortions, and Saliencycited by 9
- 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metriccited by 9
- 2022A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Mapscited by 8
- 2024Dual-Branch Network for Portrait Image Quality Assessmentcited by 8
- 2025Generalizable Video Quality Assessment via Weak-to-Strong Learningcited by 5
- 2025CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videoscited by 5
- 2025AGAV-Rater: Adapting Large Multimodal Model for AI-Generated Audio-Visual Quality Assessmentcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025VQualA 2025 Challenge on Face Image Quality Assessment: Methods and Resultscited by 4
- 2026LEIQ-Assessor: Multi-dimensional Quality Assessment of Low-light Enhanced Images via Multi-task Learningcited by 0
- 2026DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemblecited by 0
- 2026DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemble1 Jul 2026
- 2026LEIQ-Assessor: Multi-dimensional Quality Assessment of Low-light Enhanced Images via Multi-task Learning29 Jun 2026
- 2025VQualA 2025 Challenge on Face Image Quality Assessment: Methods and Results25 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2024AI-KD: Towards Alignment Invariant Face Image Quality Assessment Using Knowledge Distillation
- 2023DifFIQA: Face Image Quality Assessment Using Denoising Diffusion Probabilistic Models
- 2026Employing Vision-Language Models for Face Image Quality Assessment
- 2026EX-FIQA: Leveraging Intermediate Early eXit Representations from Vision Transformers for Face Image Quality Assessment
- 2023ProS: Facial Omni-Representation Learning via Prototype-based Self-Distillation
- 2021Distill and De-bias: Mitigating Bias in Face Verification using Knowledge Distillation
- 2026QualiTeacher: Quality-Conditioned Pseudo-Labeling for Real-World Image Restoration
- 2024FaceScore: Benchmarking and Enhancing Face Quality in Human Generation