mlsanityData to 14 Oct 2026

Efficient Face Image Quality Assessment via Self-training and Knowledge Distillation

arXiv 2507.15709 ↗First posted 21 Jul 2025cs.CVcited by 3

On the map: Knowledge distillation → General knowledge distillation methods

Abstract (arXiv)

Face image quality assessment (FIQA) is essential for various face-related applications. Although FIQA has been extensively studied and achieved significant progress, the computational complexity of FIQA algorithms remains a key concern for ensuring scalability and practical deployment in real-world systems. In this paper, we aim to develop a computationally efficient FIQA method that can be easily deployed in real-world applications. Specifically, our method consists of two stages: training a powerful teacher model and distilling a lightweight student model from it. To build a strong teacher model, we adopt a self-training strategy to improve its capacity. We first train the teacher model using labeled face images, then use it to generate pseudo-labels for a set of unlabeled images. These pseudo-labeled samples are used in two ways: (1) to distill knowledge into the student model, and (2) to combine with the original labeled images to further enhance the teacher model through self-training. The enhanced teacher model is used to further pseudo-label another set of unlabeled images for distilling the student models. The student model is trained using a combination of labeled images, pseudo-labeled images from the original teacher model, and pseudo-labeled images from the enhanced teacher model. Experimental results demonstrate that our student model achieves comparable performance to the teacher model with an extremely low computational overhead. Moreover, our method achieved first place in the ICCV 2025 VQualA FIQA Challenge. The code is available at https://github.com/sunwei925/Efficient-FIQA.git.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation. Builds on 40 of its 69 references that are in the map. First posted on arXiv 21 Jul 2025.

Builds on

40 of 69 references.

References · 40

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  4. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
  5. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  7. 2018Born Again Neural Networkscited by 546
  8. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  9. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  10. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  11. 2019Billion-scale semi-supervised learning for image classificationcited by 232
  12. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
28 more
  1. 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 225
  2. 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
  3. 2022EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applicationscited by 121
  4. 2020SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustnesscited by 112
  5. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 89
  6. 2020Face Image Quality Assessment: A Literature Surveycited by 80
  7. 2021Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Trainingcited by 71
  8. 2021SDD-FIQA: Unsupervised Face Image Quality Assessment with Similarity Distribution Distancecited by 64
  9. 2019FaceQnet: Quality Assessment for Face Recognition based on Deep Learningcited by 62
  10. 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
  11. 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
  12. 2021Deep Learning based Full-reference and No-reference Quality Assessment Models for Compressed UGC Videoscited by 27
  13. 2023Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluationcited by 27
  14. 2024Large Multi-modality Model Assisted AI-Generated Image Quality Assessmentcited by 24
  15. 2022Going the Extra Mile in Face Image Quality Assessment: A Novel Database and Modelcited by 22
  16. 2024Enhancing Blind Video Quality Assessment with Rich Quality-aware Featurescited by 19
  17. 2024DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformercited by 17
  18. 2023An Image Quality Assessment Dataset for Portraitscited by 14
  19. 2024Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Modelcited by 13
  20. 2025FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessmentcited by 13
  21. 2025AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Imagescited by 13
  22. 2024Assessing UHD Image Quality from Aesthetics, Distortions, and Saliencycited by 9
  23. 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metriccited by 9
  24. 2022A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Mapscited by 8
  25. 2024Dual-Branch Network for Portrait Image Quality Assessmentcited by 8
  26. 2025Generalizable Video Quality Assessment via Weak-to-Strong Learningcited by 5
  27. 2025CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videoscited by 5
  28. 2025AGAV-Rater: Adapting Large Multimodal Model for AI-Generated Audio-Visual Quality Assessmentcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024AI-KD: Towards Alignment Invariant Face Image Quality Assessment Using Knowledge Distillation
  2. 2023DifFIQA: Face Image Quality Assessment Using Denoising Diffusion Probabilistic Models
  3. 2026Employing Vision-Language Models for Face Image Quality Assessment
  4. 2026EX-FIQA: Leveraging Intermediate Early eXit Representations from Vision Transformers for Face Image Quality Assessment
  5. 2023ProS: Facial Omni-Representation Learning via Prototype-based Self-Distillation
  6. 2021Distill and De-bias: Mitigating Bias in Face Verification using Knowledge Distillation
  7. 2026QualiTeacher: Quality-Conditioned Pseudo-Labeling for Real-World Image Restoration
  8. 2024FaceScore: Benchmarking and Enhancing Face Quality in Human Generation