M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of AI-generated image (AIGI) models presents new challenges for evaluating image quality, particularly across three aspects: perceptual quality, prompt correspondence, and authenticity. To address these challenges, we introduce M3-AGIQA, a comprehensive framework that leverages Multimodal Large Language Models (MLLMs) to enable more human-aligned, holistic evaluation of AI-generated images across both visual and textual domains. Besides, our framework features a structured multi-round evaluation process, generating and analyzing intermediate image descriptions to provide deeper insight into these three aspects. By aligning model outputs more closely with human judgment, M3-AGIQA delivers robust and interpretable quality scores. Extensive experiments on multiple benchmarks demonstrate that our method achieves state-of-the-art performance on tested datasets and aspects, and exhibits strong generalizability in most cross-dataset settings. Code is available at https://github.com/strawhatboy/M3-AGIQA.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 42 of its 63 references that are in the map. First posted on arXiv 21 Feb 2025.
Builds on
42 of 63 references.
References · 42
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
30 more
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
- 2024xLSTM: Extended Long Short-Term Memorycited by 327
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2024Efficient Multimodal Large Language Models: A Surveycited by 96
- 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 87
- 2024"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Modelscited by 69
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
- 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 55
- 2024Vision-LSTM: xLSTM as Generic Vision Backbonecited by 51
- 2021GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessmentcited by 43
- 2024AIGIQA-20K: A Large Database for AI-Generated Image Quality Assessmentcited by 33
- 2024Large Multi-modality Model Assisted AI-Generated Image Quality Assessmentcited by 24
- 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
- 2023PKU-I2IQA: An Image-to-Image Quality Assessment Database for AI Generated Imagescited by 14
- 2023Learning to Evaluate the Artness of AI-generated Imagescited by 10
- 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessmentcited by 10
- 2023Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Tokencited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIP
- 2025Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
- 2025AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Images
- 2025Towards Explainable Partial-AIGC Image Quality Assessment
- 2025Next Token Is Enough: Realistic Image Quality and Aesthetic Scoring with Multimodal Large Language Model
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?
- 2025Revisiting MLLM Based Image Quality Assessment: Errors and Remedy
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment