Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The rapid advancement of image generation technologies intensifies the demand for interpretable and robust detection methods. Although existing approaches often attain high accuracy, they typically operate as black boxes without providing human-understandable justifications. Multi-modal Large Language Models (MLLMs), while not originally intended for forgery detection, exhibit strong analytical and reasoning capabilities. When properly fine-tuned, they can effectively identify AI-generated images and offer meaningful explanations. However, existing MLLMs still struggle with hallucination and often fail to align their visual interpretations with actual image content and human reasoning. To bridge this gap, we construct a dataset of AI-generated images annotated with bounding boxes and descriptive captions that highlight synthesis artifacts, establishing a foundation for human-aligned visual-textual grounded reasoning. We then finetune MLLMs through a multi-stage optimization strategy that progressively balances the objectives of accurate detection, visual localization, and coherent textual explanation. The resulting model achieves superior performance in both detecting AI-generated images and localizing visual flaws, significantly outperforming baseline methods.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 69 references that are in the map. First posted on arXiv 8 Jun 2025.
Builds on
20 of 69 references.
Closest ancestors · 7
Same direction, newest first
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model7 Mar
Other references · 13
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2024OpenAI o1 System Cardcited by 1,220
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
1 more
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
- 2025REVEAL: Reasoning-Enhanced Forensic Evidence Analysis for Explainable AI-Generated Image Detectioncited by 4
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detectioncited by 3
- 2026XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detectioncited by 1
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detectioncited by 1
- 2025Explainable AI-Generated Image Detection RewardBenchcited by 0
- 2025Exploring Diagnostic Prompting Approach for Multimodal LLM-based Visual Complexity Assessment: A Case Study of Amazon Search Result Pagescited by 0
- 2025Human-AI Collaboration Mechanism Study on AIGC Assisted Image Production for Special Coveragecited by 0
- 2026AniPrO: Interpretable Anime Image Provenance Detection via Multi-Dimensional Semantic Reasoningcited by 0
- 2026AniPrO: Interpretable Anime Image Provenance Detection via Multi-Dimensional Semantic Reasoning20 Sep 2026
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection28 Jul 2026
- 2026XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection3 Jul 2026
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detection24 Mar 2026
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detection18 Mar 2026
- 2025Human-AI Collaboration Mechanism Study on AIGC Assisted Image Production for Special Coverage14 Dec 2025
- 2025REVEAL: Reasoning-Enhanced Forensic Evidence Analysis for Explainable AI-Generated Image Detection28 Nov 2025
- 2025Exploring Diagnostic Prompting Approach for Multimodal LLM-based Visual Complexity Assessment: A Case Study of Amazon Search Result Pages26 Nov 2025
- 2025Explainable AI-Generated Image Detection RewardBench15 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Models
- 2025Toward Generalizable Forgery Detection and Reasoning
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection
- 2025Locate-Then-Examine: Grounded Region Reasoning Improves Detection of AI-Generated Images
- 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
- 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Models
- 2026Generalizable Detection of AI Generated Images with Large Models and Fuzzy Decision Tree
- 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline