Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
also in 1 more
Abstract (arXiv)
With the rapid advancement of artificial intelligence-generated content (AIGC) technologies, including multimodal large language models (MLLMs) and diffusion models, image generation and manipulation have become remarkably effortless. Existing image forgery detection and localization (IFDL) methods often struggle to generalize across diverse datasets and offer limited interpretability. Nowadays, MLLMs demonstrate strong generalization potential across diverse vision-language tasks, and some studies introduce this capability to IFDL via large-scale training. However, such approaches cost considerable computational resources, while failing to reveal the inherent generalization potential of vanilla MLLMs to address this problem. Inspired by this observation, we propose Foresee, a training-free MLLM-based pipeline tailored for image forgery analysis. It eliminates the need for additional training and enables a lightweight inference process, while surpassing existing MLLM-based methods in both tamper localization accuracy and the richness of textual explanations. Foresee employs a type-prior-driven strategy and utilizes a Flexible Feature Detector (FFD) module to specifically handle copy-move manipulations, thereby effectively unleashing the potential of vanilla MLLMs in the forensic domain. Extensive experiments demonstrate that our approach simultaneously achieves superior localization accuracy and provides more comprehensive textual explanations. Moreover, Foresee exhibits stronger generalization capability, outperforming existing IFDL methods across various tampering types, including copy-move, splicing, removal, local enhancement, deepfake, and AIGC-based editing. The code will be released in the final version.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 57 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
27 of 57 references.
Closest ancestors · 1
Same direction, newest first
Other references · 26
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Visual Instruction Tuningcited by 7,792
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2024GPT-4o System Cardcited by 4,467
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2023Qwen Technical Reportcited by 3,273
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
14 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 617
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
- 2020Media Forensics and DeepFakes: an overviewcited by 208
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
- 2017Image Splicing Localization Using A Multi-Task Fully Convolutional Network (MFCN)cited by 64
- 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 42
- 2025MediSee: Reasoning-based Pixel-level Perception in Medical Imagescited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking VLMs for Image Forgery Detection and Localization
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
- 2025Toward Generalizable Forgery Detection and Reasoning
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
- 2026FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Model
- 2026Universal Anti-forensics Attack against Image Forgery Detection via Multi-modal Guidance
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs