mlsanityData to 14 Oct 2026

Quality Assessment in the Era of Large Models: A Survey

arXiv 2409.00031 ↗First posted 17 Aug 2024cs.HC cs.AIcited by 26

Not on the map. Why?

Abstract (arXiv)

Quality assessment, which evaluates the visual quality level of multimedia experiences, has garnered significant attention from researchers and has evolved substantially through dedicated efforts. Before the advent of large models, quality assessment typically relied on small expert models tailored for specific tasks. While these smaller models are effective at handling their designated tasks and predicting quality levels, they often lack explainability and robustness. With the advancement of large models, which align more closely with human cognitive and perceptual processes, many researchers are now leveraging the prior knowledge embedded in these large models for quality assessment tasks. This emergence of quality assessment within the context of large models motivates us to provide a comprehensive review focusing on two key aspects: 1) the assessment of large models, and 2) the role of large models in assessment tasks. We begin by reflecting on the historical development of quality assessment. Subsequently, we move to detailed discussions of related works concerning quality assessment in the era of large models. Finally, we offer insights into the future progression and potential pathways for quality assessment in this new era. We hope this survey will enable a rapid understanding of the development of quality assessment in the era of large models and inspire further advancements in the field.

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 142 of its 261 references that are in the map. First posted on arXiv 17 Aug 2024.

Builds on

142 of 261 references.

References · 142

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  8. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  9. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  10. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  11. 2016Improved Techniques for Training GANscited by 2,970
  12. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
38 more
  1. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  2. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  3. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  4. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  9. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  10. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  12. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  13. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  14. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  15. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  16. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  17. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  18. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  19. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  20. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
  21. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  22. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  23. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  24. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  25. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
  26. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  27. 2016Generative Adversarial Text to Image Synthesiscited by 735
  28. 2022A Survey on In-context Learningcited by 721
  29. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  30. 2023ModelScope Text-to-Video Technical Reportcited by 658
  31. 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
  32. 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 550
  33. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
  34. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  35. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  36. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  37. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  38. 2023Generative Multimodal Models are In-Context Learnerscited by 446

50 most cited of 142 All 142 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 16; 2026: 7.

26 papers.

Sort:

By area:

  1. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
  2. 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
  3. 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysiscited by 11
  4. 20243DGCQA: A Quality Assessment Database for 3D AI-Generated Contentscited by 6
  5. 2025UVE: Are MLLMs Unified Evaluators for AI-Generated Videos?cited by 6
  6. 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Resultscited by 6
  7. 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directionscited by 5
  8. 2025Gamma: Toward Generic Image Assessment with Mixture of Assessment Expertscited by 5
  9. 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluationcited by 4
  10. 2025Looking Beyond the Obvious: A Survey on Abstract Concept Recognition for Video Understandingcited by 3
  11. 2026On the Adversarial Robustness of Multimodal LLM Judgescited by 3
  12. 2025OBIFormer: A Fast Attentive Denoising Framework for Oracle Bone Inscriptionscited by 2
14 more
  1. 2025Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Modelscited by 2
  2. 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Modelscited by 2
  3. 2025Enhancing Diffusion-based Restoration Models via Difficulty-Adaptive Reinforcement Learning with IQA Rewardcited by 2
  4. 2026Scaling Audio-Visual Quality Assessment Dataset via Crowdsourcingcited by 2
  5. 2025Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Headscited by 1
  6. 2025OmniQuality-R: Advancing Reward Models Through All-Encompassing Quality Assessmentcited by 1
  7. 2025AU-IQA: A Benchmark Dataset for Perceptual Quality Assessment of AI-Enhanced User-Generated Contentcited by 0
  8. 2025Predictive Quality Assessment for Mobile Secure Graphicscited by 0
  9. 2025Cost Savings from Automatic Quality Assessment of Generated Imagescited by 0
  10. 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generationcited by 0
  11. 2026A3: Towards Advertising Aesthetic Assessmentcited by 0
  12. 2026Non-identifiability of Explanations from Model Behavior in Deep Networks of Image Authenticity Judgmentscited by 0
  13. 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLMcited by 0
  14. 2026PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learningcited by 0