Can Vision-Language Models Reason about AI Edits in Images?
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Detection and localization of AI-tampered images are critical for trustworthy AI, yet modern generative models have made such manipulations increasingly difficult to identify. While traditional binary classifiers can detect image tampering, they lack interpretability and generalization. Vision-Language Models (VLMs) offer a promising alternative due to their strong visual understanding and reasoning capabilities; however, existing approaches typically rely on supervised finetuning with curated explanations rather than exploiting their inherent reasoning capabilities. In this work, we investigate whether VLMs can be trained to reason about AI-generated image edits using reinforcement learning (RL) rather than explicit reasoning supervision. Motivated by the success in Group Relative Policy Optimization (GRPO), an RL technique that incentivizes the model to reason by generating thinking traces prior to giving the final answer, we propose a GRPO-based training framework that utilizes simple accuracy and format rewards. Given an input image, the model produces a structured reasoning trace and predicts whether the image has been tampered with. A lightweight segmentation model is then guided by the reasoning output to generate pixel-level localization masks. Experiments across multiple image manipulation datasets demonstrate that our approach achieves competitive detection and localization performance compared to state-of-the-art image forgery detectors, despite requiring substantially weaker supervision. We introduce effective intersection over union (eff-IoU), a unified metric to jointly evaluate detection and localization. These results suggest that reinforcement learning provides an effective and scalable mechanism for teaching VLMs to reason about AI-generated content.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 34 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
10 of 34 references.
Closest ancestors · 3
Same direction, newest first
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection10 Feb
- 2025ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detection24 Sep
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization14 Oct
Other references · 7
- 2023Segment Anythingcited by 8,158
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
- 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detectioncited by 11
- 2022Comprehensive Dataset of Face Manipulations for Development and Evaluation of Forensic Toolscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SPARED: Reasoning-Based AI-Generated Image Detection via Adversarially Edited Data
- 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models
- 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning
- 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning
- 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RL
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models
- 2025Activating Visual Context and Commonsense Reasoning through Masked Prediction in VLMs
- 2026Be Faithful When Response: Returning Fluent and Grounded Answers for Vision-Language Models Reinforcement Learning