Quality Assessment in the Era of Large Models: A Survey
Not on the map. Why?
Abstract (arXiv)
Quality assessment, which evaluates the visual quality level of multimedia experiences, has garnered significant attention from researchers and has evolved substantially through dedicated efforts. Before the advent of large models, quality assessment typically relied on small expert models tailored for specific tasks. While these smaller models are effective at handling their designated tasks and predicting quality levels, they often lack explainability and robustness. With the advancement of large models, which align more closely with human cognitive and perceptual processes, many researchers are now leveraging the prior knowledge embedded in these large models for quality assessment tasks. This emergence of quality assessment within the context of large models motivates us to provide a comprehensive review focusing on two key aspects: 1) the assessment of large models, and 2) the role of large models in assessment tasks. We begin by reflecting on the historical development of quality assessment. Subsequently, we move to detailed discussions of related works concerning quality assessment in the era of large models. Finally, we offer insights into the future progression and potential pathways for quality assessment in this new era. We hope this survey will enable a rapid understanding of the development of quality assessment in the era of large models and inspire further advancements in the field.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 142 of its 261 references that are in the map. First posted on arXiv 17 Aug 2024.
Builds on
142 of 261 references.
References · 142
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2016Improved Techniques for Training GANscited by 2,970
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
38 more
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2022A Survey on In-context Learningcited by 721
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
- 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 550
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
50 most cited of 142 All 142 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 16; 2026: 7.
26 papers.
Sort:
By area:
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysiscited by 11
- 20243DGCQA: A Quality Assessment Database for 3D AI-Generated Contentscited by 6
- 2025UVE: Are MLLMs Unified Evaluators for AI-Generated Videos?cited by 6
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Resultscited by 6
- 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directionscited by 5
- 2025Gamma: Toward Generic Image Assessment with Mixture of Assessment Expertscited by 5
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluationcited by 4
- 2025Looking Beyond the Obvious: A Survey on Abstract Concept Recognition for Video Understandingcited by 3
- 2026On the Adversarial Robustness of Multimodal LLM Judgescited by 3
- 2025OBIFormer: A Fast Attentive Denoising Framework for Oracle Bone Inscriptionscited by 2
14 more
- 2025Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Modelscited by 2
- 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Modelscited by 2
- 2025Enhancing Diffusion-based Restoration Models via Difficulty-Adaptive Reinforcement Learning with IQA Rewardcited by 2
- 2026Scaling Audio-Visual Quality Assessment Dataset via Crowdsourcingcited by 2
- 2025Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Headscited by 1
- 2025OmniQuality-R: Advancing Reward Models Through All-Encompassing Quality Assessmentcited by 1
- 2025AU-IQA: A Benchmark Dataset for Perceptual Quality Assessment of AI-Enhanced User-Generated Contentcited by 0
- 2025Predictive Quality Assessment for Mobile Secure Graphicscited by 0
- 2025Cost Savings from Automatic Quality Assessment of Generated Imagescited by 0
- 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generationcited by 0
- 2026A3: Towards Advertising Aesthetic Assessmentcited by 0
- 2026Non-identifiability of Explanations from Model Behavior in Deep Networks of Image Authenticity Judgmentscited by 0
- 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLMcited by 0
- 2026PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learningcited by 0
- 2026PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learning19 Aug 2026
- 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLM29 Jul 2026
- 2026On the Adversarial Robustness of Multimodal LLM Judges14 Jun 2026
- 2026Non-identifiability of Explanations from Model Behavior in Deep Networks of Image Authenticity Judgments8 Apr 2026
- 2026A3: Towards Advertising Aesthetic Assessment25 Mar 2026
- 2026Scaling Audio-Visual Quality Assessment Dataset via Crowdsourcing26 Feb 2026
- 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generation13 Jan 2026
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluation24 Nov 2025
- 2025Enhancing Diffusion-based Restoration Models via Difficulty-Adaptive Reinforcement Learning with IQA Reward3 Nov 2025
- 2025Cost Savings from Automatic Quality Assessment of Generated Images17 Oct 2025
- 2025OmniQuality-R: Advancing Reward Models Through All-Encompassing Quality Assessment12 Oct 2025
- 2025Predictive Quality Assessment for Mobile Secure Graphics24 Sep 2025
14 more
- 2025Looking Beyond the Obvious: A Survey on Abstract Concept Recognition for Video Understanding28 Aug 2025
- 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Models11 Aug 2025
- 2025AU-IQA: A Benchmark Dataset for Perceptual Quality Assessment of AI-Enhanced User-Generated Content7 Aug 2025
- 2025Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Heads31 Jul 2025
- 2025Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Models25 Jun 2025
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Results3 Jun 2025
- 2025OBIFormer: A Fast Attentive Denoising Framework for Oracle Bone Inscriptions18 Apr 2025
- 2025UVE: Are MLLMs Unified Evaluators for AI-Generated Videos?13 Mar 2025
- 2025Gamma: Toward Generic Image Assessment with Mixture of Assessment Experts9 Mar 2025
- 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directions1 Mar 2025
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan 2025
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysis18 Nov 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 20243DGCQA: A Quality Assessment Database for 3D AI-Generated Contents11 Sep 2024
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysiscited by 11
- 2026On the Adversarial Robustness of Multimodal LLM Judgescited by 3
- 2025Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Modelscited by 2
- 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generationcited by 0
- 2026On the Adversarial Robustness of Multimodal LLM Judges14 Jun 2026
- 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generation13 Jan 2026
- 2025Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Models25 Jun 2025
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan 2025
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysis18 Nov 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 20243DGCQA: A Quality Assessment Database for 3D AI-Generated Contentscited by 6
- 2025UVE: Are MLLMs Unified Evaluators for AI-Generated Videos?cited by 6
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Resultscited by 6
- 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directionscited by 5
- 2025Gamma: Toward Generic Image Assessment with Mixture of Assessment Expertscited by 5
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluationcited by 4
- 2025Looking Beyond the Obvious: A Survey on Abstract Concept Recognition for Video Understandingcited by 3
- 2025OBIFormer: A Fast Attentive Denoising Framework for Oracle Bone Inscriptionscited by 2
- 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Modelscited by 2
- 2026Scaling Audio-Visual Quality Assessment Dataset via Crowdsourcingcited by 2
- 2025Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Headscited by 1
- 2025AU-IQA: A Benchmark Dataset for Perceptual Quality Assessment of AI-Enhanced User-Generated Contentcited by 0
12 most cited of 17 All 17 (JSON)
- 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLM29 Jul 2026
- 2026Non-identifiability of Explanations from Model Behavior in Deep Networks of Image Authenticity Judgments8 Apr 2026
- 2026A3: Towards Advertising Aesthetic Assessment25 Mar 2026
- 2026Scaling Audio-Visual Quality Assessment Dataset via Crowdsourcing26 Feb 2026
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluation24 Nov 2025
- 2025Cost Savings from Automatic Quality Assessment of Generated Images17 Oct 2025
- 2025Predictive Quality Assessment for Mobile Secure Graphics24 Sep 2025
- 2025Looking Beyond the Obvious: A Survey on Abstract Concept Recognition for Video Understanding28 Aug 2025
- 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Models11 Aug 2025
- 2025AU-IQA: A Benchmark Dataset for Perceptual Quality Assessment of AI-Enhanced User-Generated Content7 Aug 2025
- 2025Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Heads31 Jul 2025
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Results3 Jun 2025
12 newest of 17 All 17 (JSON)