From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality
Not on the map. Why?
Abstract (arXiv)
Blind or no-reference (NR) perceptual picture quality prediction is a difficult, unsolved problem of great consequence to the social and streaming media industries that impacts billions of viewers daily. Unfortunately, popular NR prediction models perform poorly on real-world distorted pictures. To advance progress on this problem, we introduce the largest (by far) subjective picture quality database, containing about 40000 real-world distorted pictures and 120000 patches, on which we collected about 4M human judgments of picture quality. Using these picture and patch quality labels, we built deep region-based architectures that learn to produce state-of-the-art global picture quality predictions as well as useful local picture quality maps. Our innovations include picture quality prediction architectures that produce global-to-local inferences as well as local-to-global inferences (via feedback).
Key facts. Cited by 221 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 24; 2023: 40; 2024: 70; 2025: 42; 2026: 29.
221 papers.
Sort:
By area:
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
38 more
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
- 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
- 2021Image Quality Assessment using Contrastive Learningcited by 95
- 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2023Contrastive Semi-supervised Learning for Underwater Image Restoration via Reliable Bankcited by 68
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2023VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretrainingcited by 63
- 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 54
- 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
- 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
- 2022DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessmentcited by 41
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2021Continual Learning for Blind Image Quality Assessmentcited by 36
- 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generationcited by 35
- 2022PyTorch Image Quality: Metrics for Image Quality Assessmentcited by 34
- 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 34
- 2024Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessmentcited by 31
- 2024FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolutioncited by 31
- 2022Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loopcited by 30
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2022Video compression dataset and benchmark of learning-based video-quality metricscited by 27
- 2022Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelitycited by 24
- 2023Exploring Opinion-unaware Video Quality Assessment with Semantic Affinity Criterioncited by 23
- 2023Exploring the Naturalness of AI-Generated Imagescited by 22
- 2024Q-Refine: A Perceptual Quality Refiner for AI-Generated Imagecited by 21
- 2024Similarity and Quality Metrics for MR Image-To-Image Translationcited by 20
- 2025UltraFusion: Ultra High Dynamic Imaging using Exposure Fusioncited by 20
- 2023Towards Benchmarking and Assessing Visual Naturalness of Physical World Adversarial Attackscited by 18
- 2022Universal Perturbation Attack on Differentiable No-Reference Image- and Video-Quality Metricscited by 17
- 2023Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessmentcited by 17
- 2024DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformercited by 17
- 2023Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessmentcited by 16
- 2024UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessmentcited by 16
- 2023Quality-aware Pre-trained Models for Blind Image Quality Assessmentcited by 15
50 most cited of 221 All 221 (JSON)
- 2026Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment29 Sep 2026
- 2026LLPR: Location-aware learning and physics-based reconstruction for raindrop removal from a single image25 Sep 2026
- 2026Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliency3 Aug 2026
- 2026A Reference-Free Framework for Evaluating Single-Frame ISP Pipelines25 Jul 2026
- 2026Coarse-to-fine Framework for Generative MEF via Implicit Neural Representation20 Jul 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions6 Jul 2026
- 2026ExpoMotion: A Large-Scale Benchmark and A Householder Projection Network for Multi-Exposure Fusion3 Jul 2026
- 2026PrISM-IQA: Image Quality Assessment Made Practical for Smartphone Photography30 Jun 2026
- 2026Spatially Localized Image Degradation Embeddings for Image Quality Assessment28 Jun 2026
- 2026Fusing Transferred Priors and Physics-based Decomposition for Underwater Image Enhancement14 Jun 2026
- 2026Parameter-Efficient Adaptation of a Multi-Stream Vision-Language Framework for Blind Image Quality Assessment1 Jun 2026
38 more
- 2026Ultra-High-Definition Image Quality Assessment via Graph Representation Learning21 May 2026
- 2026Unleashing Vision Transformer Potential In Image Quality Assessment via Global-Local Adaptive Interaction18 May 2026
- 2026PRISM: Rethinking Atmospheric Scattering Reconstruction as a Unified Understanding and Restoration Model for Real-world Dehazing8 Apr 2026
- 2026PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis6 Apr 2026
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro3 Apr 2026
- 2026Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models23 Mar 2026
- 2026Preference-Guided Debiasing for No-Reference Enhancement Image Quality Assessment20 Mar 2026
- 2026SHAMISA: SHAped Modeling of Implicit Structural Associations for Self-supervised No-Reference Image Quality Assessment14 Mar 2026
- 2026How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices5 Mar 2026
- 2026Position: Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centered28 Feb 2026
- 2026Perceptual Quality Optimization of Image Super-Resolution25 Feb 2026
- 2026Can Image Splicing and Copy-Move Forgery Be Detected by the Same Model? Forensim: An Attention-Based State-Space Approach10 Feb 2026
- 2026DR.Experts: Differential Refinement of Distortion-Aware Experts for Blind Image Quality Assessment10 Feb 2026
- 2026Surveillance Facial Image Quality Assessment: A Multi-dimensional Dataset and Lightweight Model7 Feb 2026
- 2026ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images3 Feb 2026
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment30 Jan 2026
- 2026Rescind: Countering Image Misconduct in Biomedical Publications with Vision-Language and State-Space Modeling12 Jan 2026
- 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Model10 Dec 2025
- 2025DEAR: Dataset for Evaluating the Aesthetics of Rendering4 Dec 2025
- 2025Beyond Pixels: Benchmarking and Reward-Based Assessing Framework for Visual Spatial Aesthetics4 Dec 2025
- 2025StableMorph: High-Quality Face Morph Generation with Stable Diffusion11 Nov 2025
- 2025MUGSQA: Novel Multi-Uncertainty-Based Gaussian Splatting Quality Assessment Method, Dataset, and Benchmarks10 Nov 2025
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment7 Nov 2025
- 2025Rethinking Nighttime Image Deraining via Learnable Color Space Transformation20 Oct 2025
- 2025iDETEX: Empowering MLLMs for Intelligent DETailed EXplainable IQA20 Oct 2025
- 2025CHUG: Crowdsourced User-Generated HDR Video Quality Dataset10 Oct 2025
- 2025HandEval: Taking the First Step Towards Hand Quality Evaluation in Generated Images10 Oct 2025
- 2025SEGA: A Transferable Signed Ensemble Gaussian Black-Box Attack against No-Reference Image Quality Assessment Models23 Sep 2025
- 2025Describe-to-Score: A text-guided framework for image complexity assessment20 Sep 2025
- 2025HazeFlow: Revisit Haze Physical Model as ODE and Non-Homogeneous Haze Generation for Real-World Dehazing19 Sep 2025
- 2025VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Results11 Sep 2025
- 2025Parameter-Efficient Adaptation of mPLUG-Owl2 via Pixel-Level Visual Prompts for NR-IQA3 Sep 2025
- 2025Style4D-Bench: A Benchmark Suite for 4D Stylization26 Aug 2025
- 2025MDIQA: Unified Image Quality Assessment for Multi-dimensional Evaluation and Restoration23 Aug 2025
- 2025HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessment20 Aug 2025
- 2025A Parametric Bi-Directional Curvature-Based Framework for Image Artifact Classification and Quantification12 Aug 2025
- 2025Annotation-Free Human Sketch Quality Assessment28 Jul 2025
- 2025DEFNet: Multitasks-based Deep Evidential Fusion Network for Blind Image Quality Assessment25 Jul 2025
50 newest of 221 All 221 (JSON)
- 2024FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolutioncited by 31
- 2024DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wildcited by 14
- 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Modelcited by 9
- 2024AdaDiffSR: Adaptive Region-aware Dynamic Acceleration Diffusion Model for Real-World Image Super-Resolutioncited by 8
- 2024Feature Denoising Diffusion Model for Blind Image Quality Assessmentcited by 5
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalizationcited by 3
- 2025Latent Guidance in Diffusion Models for Perceptual Evaluationscited by 2
- 2025StableMorph: High-Quality Face Morph Generation with Stable Diffusioncited by 2
- 2024SemiDDM-Weather: A Semi-supervised Learning Framework for All-in-one Adverse Weather Removalcited by 1
- 2026Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Modelscited by 1
- 2024Rician Denoising Diffusion Probabilistic Models For Sodium Breast MRI Enhancementcited by 0
- 2024IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis6 Apr 2026
- 2026Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models23 Mar 2026
- 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Model10 Dec 2025
- 2025StableMorph: High-Quality Face Morph Generation with Stable Diffusion11 Nov 2025
- 2025Latent Guidance in Diffusion Models for Perceptual Evaluations31 May 2025
- 2025Leveraging the Powerful Attention of a Pre-trained Diffusion Model for Exemplar-based Image Colorization21 May 2025
- 2024IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models2 Dec 2024
- 2024FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolution27 Nov 2024
- 2024AdaDiffSR: Adaptive Region-aware Dynamic Acceleration Diffusion Model for Real-World Image Super-Resolution23 Oct 2024
- 2024Rician Denoising Diffusion Probabilistic Models For Sodium Breast MRI Enhancement15 Oct 2024
- 2024SemiDDM-Weather: A Semi-supervised Learning Framework for All-in-one Adverse Weather Removal29 Sep 2024
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalization7 Jun 2024
12 newest of 14 All 14 (JSON)
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2023VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretrainingcited by 63
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024VisualCritic: Making LMMs Perceive Visual Quality Like Humanscited by 13
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
- 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessmentcited by 12
- 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessmentcited by 12
- 2024Few-Shot Image Quality Assessment via Adaptation of Vision-Language Modelscited by 4
- 2025Mitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategycited by 1
- 2025VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Resultscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment29 Sep 2026
- 2025VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Results11 Sep 2025
- 2025Mitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategy26 Mar 2025
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan 2025
- 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessment26 Nov 2024
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuning15 Nov 2024
- 2024Few-Shot Image Quality Assessment via Adaptation of Vision-Language Models9 Sep 2024
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models26 Aug 2024
- 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessment3 Jun 2024
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare29 May 2024
- 2024VisualCritic: Making LMMs Perceive Visual Quality Like Humans19 Mar 2024
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment16 Mar 2024
12 newest of 13 All 13 (JSON)
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
12 most cited of 191 All 191 (JSON)
- 2026LLPR: Location-aware learning and physics-based reconstruction for raindrop removal from a single image25 Sep 2026
- 2026Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliency3 Aug 2026
- 2026A Reference-Free Framework for Evaluating Single-Frame ISP Pipelines25 Jul 2026
- 2026Coarse-to-fine Framework for Generative MEF via Implicit Neural Representation20 Jul 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions6 Jul 2026
- 2026ExpoMotion: A Large-Scale Benchmark and A Householder Projection Network for Multi-Exposure Fusion3 Jul 2026
- 2026PrISM-IQA: Image Quality Assessment Made Practical for Smartphone Photography30 Jun 2026
- 2026Spatially Localized Image Degradation Embeddings for Image Quality Assessment28 Jun 2026
- 2026Fusing Transferred Priors and Physics-based Decomposition for Underwater Image Enhancement14 Jun 2026
- 2026Parameter-Efficient Adaptation of a Multi-Stream Vision-Language Framework for Blind Image Quality Assessment1 Jun 2026
- 2026Ultra-High-Definition Image Quality Assessment via Graph Representation Learning21 May 2026
12 newest of 191 All 191 (JSON)