Towards Generalized Image Manipulation Localization via Score-based Model
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
With the rapid evolution of synthetic media, Image Manipulation Localization (IML) has emerged as a critical component in multimedia forensics for ensuring the integrity of digital content. However, generalization remains a core challenge, as existing discriminative methods typically learn a fixed decision boundary that tends to overfit to specific training artifacts and fails to adapt to unseen manipulation types. To address this, we propose DiffIML, a novel framework that introduces score-based generative modeling to IML. Diverging from the direct estimation of hard boundaries, DiffIML approximates the score function, the gradient of the log-likelihood, to capture the intrinsic geometric topology of mask distributions. This paradigm leverages structural priors to iteratively recover coherent masks from noise, thereby circumventing the brittleness associated with discriminative models. Under this formulation, diffusion models serve as an effective numerical solver for the learned score function.To ensure practicality, we respectively resolve the efficiency and stability bottlenecks of standard diffusion by: (1) utilizing a Lightweight Mask-Specific VAE for fast latent-space process and a decoupled architecture with a lightweight denoising UNet, (2) edge supervision and error prior to mitigate error accumulation during sampling. Extensive experiments of two distinct protocols on eight non-generative and three generative benchmarks demonstrate that DiffIML consistently outperforms state-of-the-art methods, yielding remarkable generalization improvements on diverse unseen datasets. The code is publicly available at https://github.com/scu-zjz/DiffIML.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 14 of its 33 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
14 of 33 references.
References · 14
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2018Learning Rich Features for Image Manipulation Detectioncited by 154
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
- 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
- 2017Image Splicing Localization Using A Multi-Task Fully Convolutional Network (MFCN)cited by 64
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
- 2019Learn to Segment Retinal Lesions and Beyondcited by 33
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization
- 2026Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline
- 2025CLUE: Leveraging Low-Rank Adaptation to Capture Latent Uncovered Evidence for Image Forgery Localization
- 2025Training-Free In-Context Forensic Chain for Image Manipulation Detection and Localization
- 2025CBDiff:Conditional Bernoulli Diffusion Models for Image Forgery Localization
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation