mlsanityData to 14 Oct 2026

AI-Generated Image Quality Assessment Based on Task-Specific Prompt and Multi-Granularity Similarity

arXiv 2411.16087 ↗First posted 25 Nov 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Recently, AI-generated images (AIGIs) created by given prompts (initial prompts) have garnered widespread attention. Nevertheless, due to technical nonproficiency, they often suffer from poor perception quality and Text-to-Image misalignment. Therefore, assessing the perception quality and alignment quality of AIGIs is crucial to improving the generative model's performance. Existing assessment methods overly rely on the initial prompts in the task prompt design and use the same prompts to guide both perceptual and alignment quality evaluation, overlooking the distinctions between the two tasks. To address this limitation, we propose a novel quality assessment method for AIGIs named TSP-MGS, which designs task-specific prompts and measures multi-granularity similarity between AIGIs and the prompts. Specifically, task-specific prompts are first constructed to describe perception and alignment quality degrees separately, and the initial prompt is introduced for detailed quality perception. Then, the coarse-grained similarity between AIGIs and task-specific prompts is calculated, which facilitates holistic quality awareness. In addition, to improve the understanding of AIGI details, the fine-grained similarity between the image and the initial prompt is measured. Finally, precise quality prediction is acquired by integrating the multi-granularity similarities. Experiments on the commonly used AGIQA-1K and AGIQA-3K benchmarks demonstrate the superiority of the proposed TSP-MGS.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 46 of its 71 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

46 of 71 references.

References · 46

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  7. 2021Grounded Language-Image Pre-trainingcited by 1,156
  8. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  9. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  10. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  11. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  12. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
34 more
  1. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  2. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
  3. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  4. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
  5. 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 627
  6. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
  7. 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
  8. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  9. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
  10. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
  11. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  12. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  13. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  14. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 223
  15. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
  16. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 166
  17. 2022SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentationcited by 164
  18. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  19. 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 151
  20. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  21. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  22. 2020Transformer for Image Quality Assessmentcited by 76
  23. 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
  24. 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 55
  25. 2021Perceptual Image Quality Assessment with Transformerscited by 54
  26. 2018Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learningcited by 49
  27. 2021Continual Learning for Blind Image Quality Assessmentcited by 36
  28. 2020Active Fine-Tuning from gMAD Examples Improves Blind Image Quality Assessmentcited by 24
  29. 2024Bringing Textual Prompt to AI-Generated Image Quality Assessmentcited by 12
  30. 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
  31. 2024Vision-Language Consistency Guided Multi-modal Prompt Learning for Blind AI Generated Image Quality Assessmentcited by 9
  32. 2024PCQA: A Strong Baseline for AIGC Quality Assessment Based on Prompt Conditioncited by 6
  33. 2023Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Tokencited by 5
  34. 2023GrowCLIP: Data-aware Automatic Model Growing for Large-scale Contrastive Language-Image Pre-trainingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.