AI-generated Image Quality Assessment in Visual Communication
Not on the map. Why?
Abstract (arXiv)
Assessing the quality of artificial intelligence-generated images (AIGIs) plays a crucial role in their application in real-world scenarios. However, traditional image quality assessment (IQA) algorithms primarily focus on low-level visual perception, while existing IQA works on AIGIs overemphasize the generated content itself, neglecting its effectiveness in real-world applications. To bridge this gap, we propose AIGI-VC, a quality assessment database for AI-Generated Images in Visual Communication, which studies the communicability of AIGIs in the advertising field from the perspectives of information clarity and emotional interaction. The dataset consists of 2,500 images spanning 14 advertisement topics and 8 emotion types. It provides coarse-grained human preference annotations and fine-grained preference descriptions, benchmarking the abilities of IQA methods in preference prediction, interpretation, and reasoning. We conduct an empirical study of existing representative IQA methods and large multi-modal models on the AIGI-VC dataset, uncovering their strengths and weaknesses.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 20 Dec 2024.
Builds on
23 of 50 references.
References · 23
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 215
- 2018PieAPP: Perceptual Image-Error Assessment through Pairwise Preferencecited by 160
- 2023Holistic Evaluation of Text-To-Image Modelscited by 160
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
11 more
- 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 108
- 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 87
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2019dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairscited by 73
- 2017Automatic Understanding of Image and Video Advertisementscited by 68
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2024AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perceptioncited by 54
- 2023Exploring the Naturalness of AI-Generated Imagescited by 22
- 2023Learning to Evaluate the Artness of AI-generated Imagescited by 10
- 2023Iterative Token Evaluation and Refinement for Real-World Super-Resolutioncited by 8
- 2024ReCorD: Reasoning and Correcting Diffusion for HOI Generationcited by 6
Built on by
Citing papers per year: 2025: 5; 2026: 2.
7 papers.
- 2025AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Imagescited by 13
- 2025AgenticIQA: An Agentic Framework for Adaptive and Interpretable Image Quality Assessmentcited by 2
- 2025Plug In, Grade Right: Psychology-Inspired AGIQAcited by 2
- 2025Preserve Anything: Controllable Image Synthesis with Object Preservationcited by 1
- 2025VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Resultscited by 0
- 2026R4-CGQA: Retrieval-based Vision Language Models for Computer Graphics Image Quality Assessmentcited by 0
- 2026AGIDefect-4K: A Richly Annotated Dataset for AI-Generated Image Defect Detection, Localization and Explanationcited by 0
- 2026AGIDefect-4K: A Richly Annotated Dataset for AI-Generated Image Defect Detection, Localization and Explanation21 Aug 2026
- 2026R4-CGQA: Retrieval-based Vision Language Models for Computer Graphics Image Quality Assessment11 Mar 2026
- 2025Plug In, Grade Right: Psychology-Inspired AGIQA28 Dec 2025
- 2025AgenticIQA: An Agentic Framework for Adaptive and Interpretable Image Quality Assessment30 Sep 2025
- 2025VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Results11 Sep 2025
- 2025Preserve Anything: Controllable Image Synthesis with Object Preservation27 Jun 2025
- 2025AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Images30 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025AU-IQA: A Benchmark Dataset for Perceptual Quality Assessment of AI-Enhanced User-Generated Content
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment
- 2023A Perceptual Quality Assessment Exploration for AIGC Images
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?
- 2026MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement
- 2025Image Quality Assessment for Embodied AI
- 2025Beyond Pixels: Benchmarking and Reward-Based Assessing Framework for Visual Spatial Aesthetics
- 2024PCQA: A Strong Baseline for AIGC Quality Assessment Based on Prompt Condition