AI-Generated Image Quality Assessment Based on Task-Specific Prompt and Multi-Granularity Similarity
Not on the map. Why?
Abstract (arXiv)
Recently, AI-generated images (AIGIs) created by given prompts (initial prompts) have garnered widespread attention. Nevertheless, due to technical nonproficiency, they often suffer from poor perception quality and Text-to-Image misalignment. Therefore, assessing the perception quality and alignment quality of AIGIs is crucial to improving the generative model's performance. Existing assessment methods overly rely on the initial prompts in the task prompt design and use the same prompts to guide both perceptual and alignment quality evaluation, overlooking the distinctions between the two tasks. To address this limitation, we propose a novel quality assessment method for AIGIs named TSP-MGS, which designs task-specific prompts and measures multi-granularity similarity between AIGIs and the prompts. Specifically, task-specific prompts are first constructed to describe perception and alignment quality degrees separately, and the initial prompt is introduced for detailed quality perception. Then, the coarse-grained similarity between AIGIs and task-specific prompts is calculated, which facilitates holistic quality awareness. In addition, to improve the understanding of AIGI details, the fine-grained similarity between the image and the initial prompt is measured. Finally, precise quality prediction is acquired by integrating the multi-granularity similarities. Experiments on the commonly used AGIQA-1K and AGIQA-3K benchmarks demonstrate the superiority of the proposed TSP-MGS.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 46 of its 71 references that are in the map. First posted on arXiv 25 Nov 2024.
Builds on
46 of 71 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
34 more
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
- 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 627
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 223
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 166
- 2022SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentationcited by 164
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 151
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
- 2020Transformer for Image Quality Assessmentcited by 76
- 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
- 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 55
- 2021Perceptual Image Quality Assessment with Transformerscited by 54
- 2018Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learningcited by 49
- 2021Continual Learning for Blind Image Quality Assessmentcited by 36
- 2020Active Fine-Tuning from gMAD Examples Improves Blind Image Quality Assessmentcited by 24
- 2024Bringing Textual Prompt to AI-Generated Image Quality Assessmentcited by 12
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
- 2024Vision-Language Consistency Guided Multi-modal Prompt Learning for Blind AI Generated Image Quality Assessmentcited by 9
- 2024PCQA: A Strong Baseline for AIGC Quality Assessment Based on Prompt Conditioncited by 6
- 2023Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Tokencited by 5
- 2023GrowCLIP: Data-aware Automatic Model Growing for Large-scale Contrastive Language-Image Pre-trainingcited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Text-Visual Semantic Constrained AI-Generated Image Quality Assessmentcited by 6
- 2025Plug In, Grade Right: Psychology-Inspired AGIQAcited by 2
- 2026CAP-IQA: Context-Aware Prompt-Guided CT Image Quality Assessmentcited by 0
- 2026Patch Knowledge Transfer for Efficient AI-Generated Image Quality Assessmentcited by 0
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessmentcited by 0
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessment25 Aug 2026
- 2026Patch Knowledge Transfer for Efficient AI-Generated Image Quality Assessment6 Jul 2026
- 2026CAP-IQA: Context-Aware Prompt-Guided CT Image Quality Assessment4 Jan 2026
- 2025Plug In, Grade Right: Psychology-Inspired AGIQA28 Dec 2025
- 2025Text-Visual Semantic Constrained AI-Generated Image Quality Assessment14 Jul 2025