mlsanityData to 7 Oct 2026

Position: Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centered

arXiv 2603.00643 ↗First posted 28 Feb 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

This position paper argues that the evaluation of modern visual processing systems should no longer be driven primarily by single-metric image quality assessment benchmarks, particularly in the era of generative and perception-oriented methods. Image restoration exemplifies this divergence: while objective IQA metrics enable reproducible, scalable evaluation, they have increasingly drifted apart from human perception and user preferences. We contend that this mismatch risks constraining innovation and misguiding research progress across visual processing tasks. Rather than rejecting metrics altogether, this paper calls for a rebalancing of evaluation paradigms, advocating a more human-centered, context-aware, and fine-grained approach to assessing the visual models' outcomes.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

39 of 60 references.

References · 39

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  4. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  5. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  6. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  7. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  8. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  9. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  10. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  11. 2020Pre-Trained Image Processing Transformercited by 891
  12. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
27 more
  1. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  2. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  3. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  4. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
  5. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  6. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
  7. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
  8. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
  9. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
  10. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
  11. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
  12. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  13. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
  14. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  15. 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
  16. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
  17. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  18. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
  19. 2020Efficient Image Super-Resolution Using Pixel Attentioncited by 87
  20. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  21. 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessmentcited by 41
  22. 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
  23. 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 34
  24. 2025Harnessing Diffusion-Yielded Score Priors for Image Restorationcited by 34
  25. 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
  26. 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Modelcited by 9
  27. 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Resultscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.