ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detection
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The increasing realism of AI-generated images has raised serious concerns about misinformation and privacy violations, highlighting the urgent need for accurate and interpretable detection methods. While existing approaches have made progress, most rely on binary classification without explanations or depend heavily on supervised fine-tuning, resulting in limited generalization. In this paper, we propose ThinkFake, a novel reasoning-based and generalizable framework for AI-generated image detection. Our method leverages a Multimodal Large Language Model (MLLM) equipped with a forgery reasoning prompt and is trained using Group Relative Policy Optimization (GRPO) reinforcement learning with carefully designed reward functions. This design enables the model to perform step-by-step reasoning and produce interpretable, structured outputs. We further introduce a structured detection pipeline to enhance reasoning quality and adaptability. Extensive experiments show that ThinkFake outperforms state-of-the-art methods on the GenImage benchmark and demonstrates strong zero-shot generalization on the challenging LOKI benchmark. These results validate our framework's effectiveness and robustness. Code will be released upon acceptance.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 46 references that are in the map. First posted on arXiv 24 Sep 2025.
Builds on
20 of 46 references.
Closest ancestors · 2
Same direction, newest first
- 2025Toward Generalizable Forgery Detection and Reasoning27 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
Other references · 18
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 156
- 2024Does Prompt Formatting Have Any Impact on LLM Performance?cited by 141
- 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
- 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 96
6 more
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Modelscited by 8
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
- 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignmentcited by 4
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detectioncited by 4
- 2026AI-generated Images Challenge Visual Trust in High-risk Scenarioscited by 1
- 2026Can Vision-Language Models Reason about AI Edits in Images?cited by 0
- 2026Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detectioncited by 0
- 2026Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection30 Sep 2026
- 2026Can Vision-Language Models Reason about AI Edits in Images?30 Jul 2026
- 2026AI-generated Images Challenge Visual Trust in High-risk Scenarios23 Jul 2026
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localization13 May 2026
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detection18 Mar 2026
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection11 Dec 2025
- 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignment7 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detection
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection
- 2026Generalizable Detection of AI Generated Images with Large Models and Fuzzy Decision Tree
- 2026MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models
- 2025Training-Free Multimodal Deepfake Detection via Graph Reasoning
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection
- 2026Pixels Don't Lie (But Your Detector Might): Bootstrapping MLLM-as-a-Judge for Trustworthy Deepfake Detection and Reasoning Supervision