Position: Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centered
Not on the map. Why?
Abstract (arXiv)
This position paper argues that the evaluation of modern visual processing systems should no longer be driven primarily by single-metric image quality assessment benchmarks, particularly in the era of generative and perception-oriented methods. Image restoration exemplifies this divergence: while objective IQA metrics enable reproducible, scalable evaluation, they have increasingly drifted apart from human perception and user preferences. We contend that this mismatch risks constraining innovation and misguiding research progress across visual processing tasks. Rather than rejecting metrics altogether, this paper calls for a rebalancing of evaluation paradigms, advocating a more human-centered, context-aware, and fine-grained approach to assessing the visual models' outcomes.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 28 Feb 2026.
Builds on
39 of 60 references.
References · 39
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2020Pre-Trained Image Processing Transformercited by 891
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
27 more
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
- 2020Efficient Image Super-Resolution Using Pixel Attentioncited by 87
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessmentcited by 41
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
- 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 34
- 2025Harnessing Diffusion-Yielded Score Priors for Image Restorationcited by 34
- 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
- 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Modelcited by 9
- 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Resultscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.