mlsanityData to 14 Oct 2026

M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment

arXiv 2502.15167 ↗First posted 21 Feb 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The rapid advancement of AI-generated image (AIGI) models presents new challenges for evaluating image quality, particularly across three aspects: perceptual quality, prompt correspondence, and authenticity. To address these challenges, we introduce M3-AGIQA, a comprehensive framework that leverages Multimodal Large Language Models (MLLMs) to enable more human-aligned, holistic evaluation of AI-generated images across both visual and textual domains. Besides, our framework features a structured multi-round evaluation process, generating and analyzing intermediate image descriptions to provide deeper insight into these three aspects. By aligning model outputs more closely with human judgment, M3-AGIQA delivers robust and interpretable quality scores. Extensive experiments on multiple benchmarks demonstrate that our method achieves state-of-the-art performance on tested datasets and aspects, and exhibits strong generalizability in most cross-dataset settings. Code is available at https://github.com/strawhatboy/M3-AGIQA.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 42 of its 63 references that are in the map. First posted on arXiv 21 Feb 2025.

Builds on

42 of 63 references.

References · 42

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  10. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  11. 2017Improved Training of Wasserstein GANscited by 2,235
  12. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
30 more
  1. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  2. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  3. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  4. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  5. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  6. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  7. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
  8. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
  9. 2024xLSTM: Extended Long Short-Term Memorycited by 327
  10. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
  11. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  12. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  13. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
  14. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  15. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  16. 2024Efficient Multimodal Large Language Models: A Surveycited by 96
  17. 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 87
  18. 2024"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Modelscited by 69
  19. 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
  20. 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
  21. 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 55
  22. 2024Vision-LSTM: xLSTM as Generic Vision Backbonecited by 51
  23. 2021GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessmentcited by 43
  24. 2024AIGIQA-20K: A Large Database for AI-Generated Image Quality Assessmentcited by 33
  25. 2024Large Multi-modality Model Assisted AI-Generated Image Quality Assessmentcited by 24
  26. 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
  27. 2023PKU-I2IQA: An Image-to-Image Quality Assessment Database for AI Generated Imagescited by 14
  28. 2023Learning to Evaluate the Artness of AI-generated Imagescited by 10
  29. 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessmentcited by 10
  30. 2023Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Tokencited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIP
  2. 2025Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
  3. 2025AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Images
  4. 2025Towards Explainable Partial-AIGC Image Quality Assessment
  5. 2025Next Token Is Enough: Realistic Image Quality and Aesthetic Scoring with Multimodal Large Language Model
  6. 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?
  7. 2025Revisiting MLLM Based Image Quality Assessment: Errors and Remedy
  8. 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment