Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detection
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
also in 1 more
Abstract (arXiv)
Existing image forgery detection (IFD) methods either exploit low-level, semantics-agnostic artifacts or rely on multimodal large language models (MLLMs) with high-level semantic knowledge. Although naturally complementary, these two information streams are highly heterogeneous in both paradigm and reasoning, making it difficult for existing methods to unify them or effectively model their cross-level interactions. To address this gap, we propose ForenAgent, a multi-round interactive IFD framework that enables MLLMs to autonomously generate, execute, and iteratively refine Python-based low-level tools around the detection objective, thereby achieving more flexible and interpretable forgery analysis. ForenAgent follows a two-stage training pipeline combining Cold Start and Reinforcement Fine-Tuning to enhance its tool interaction capability and reasoning adaptability progressively. Inspired by human reasoning, we design a dynamic reasoning loop comprising global perception, local focusing, iterative probing, and holistic adjudication, and instantiate it as both a data-sampling strategy and a task-aligned process reward. For systematic training and evaluation, we construct FABench, a heterogeneous, high-quality agent-forensics dataset comprising 100k images and approximately 200k agent-interaction question-answer pairs. Experiments show that ForenAgent exhibits emergent tool-use competence and reflective reasoning on challenging IFD tasks when assisted by low-level tools, charting a promising route toward general-purpose IFD. The code will be released after the review process is completed.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 43 of its 66 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
43 of 66 references.
Closest ancestors · 4
Same direction, newest first
- 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Models3 Jul
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models13 Oct
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models3 Oct
Other references · 39
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 603
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
27 more
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
- 2025Thyme: Think Beyond Imagescited by 167
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 89
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2024Common Sense Reasoning for Deepfake Detectioncited by 65
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
- 2025Visual Agentic Reinforcement Fine-Tuningcited by 55
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 43
- 2025Reinforced Visual Perception with Toolscited by 38
- 2023Detecting Generated Images by Real Images Onlycited by 20
- 2025FakeScope: Large Multimodal Expert Model for Transparent AI-Generated Image Forensicscited by 11
- 2022A Principled Design of Image Representation: Towards Forensic Taskscited by 8
- 2024MetaTool: Facilitating Large Language Models to Master Tools with Meta-task Augmentationcited by 6
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Rankingcited by 17
- 2026TUE-Detector: A Tool-Using Expert MLLM-Based Detector for AI-Generated Videoscited by 0
- 2026Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detectioncited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnessescited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection21 Sep 2026
- 2026TUE-Detector: A Tool-Using Expert MLLM-Based Detector for AI-Generated Videos31 Aug 2026
- 2026ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Ranking10 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection
- 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Models
- 2025Toward Generalizable Forgery Detection and Reasoning
- 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
- 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
- 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection