mlsanityData to 14 Oct 2026

UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization

arXiv 2508.06101 ↗First posted 8 Aug 2025cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In the digital age, advanced image editing tools pose a serious threat to the integrity of visual content, making image forgery detection and localization a key research focus. Most existing Image Manipulation Localization (IML) methods rely on discriminative learning and require large, high-quality annotated datasets. However, current datasets lack sufficient scale and diversity, limiting model performance in real-world scenarios. To overcome this, recent studies have explored Constrained IML (CIML), which generates pixel-level annotations through algorithmic supervision. However, existing CIML approaches often depend on complex multi-stage pipelines, making the annotation process inefficient. In this work, we propose a novel generative framework based on diffusion models, named UGD-IML, which for the first time unifies both IML and CIML tasks within a single framework. By learning the underlying data distribution, generative diffusion models inherently reduce the reliance on large-scale labeled datasets, allowing our approach to perform effectively even under limited data conditions. In addition, by leveraging a class embedding mechanism and a parameter-sharing design, our model seamlessly switches between IML and CIML modes without extra components or training overhead. Furthermore, the end-to-end design enables our model to avoid cumbersome steps in the data annotation process. Extensive experimental results on multiple datasets demonstrate that UGD-IML outperforms the SOTA methods by an average of 9.66 and 4.36 in terms of F1 metrics for IML and CIML tasks, respectively. Moreover, the proposed method also excels in uncertainty estimation, visualization and robustness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 23 of its 43 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

23 of 43 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025BEVDiffuser: Plug-and-Play Diffusion Model for BEV Denoising with Ground-Truth Guidance27 Feb
  2. 2023DDP: Diffusion Model for Dense Visual Prediction30 Mar
  3. 2022DiffusionDet: Diffusion Model for Object Detection17 Nov
  4. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov

Other references · 19

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  6. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  7. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  8. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
  9. 2018Learning Rich Features for Image Manipulation Detectioncited by 154
  10. 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
  11. 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
  12. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
7 more
  1. 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
  2. 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
  3. 2022DiffusionInst: Diffusion Model for Instance Segmentationcited by 49
  4. 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
  5. 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Processcited by 29
  6. 2017Deep Matching and Validation Network -- An End-to-End Solution to Constrained Image Splicing Localization and Detectioncited by 25
  7. 2023Diffusion models meet image counter-forensicscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline
  2. 2026Towards Generalized Image Manipulation Localization via Score-based Model
  3. 2024Omni-IML: Towards Unified Image Manipulation Localization
  4. 2026Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization
  5. 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization
  6. 2025From Passive Perception to Active Memory: A Weakly Supervised Image Manipulation Localization Framework Driven by Coarse-Grained Annotations
  7. 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation
  8. 2025Can VLMs Detect and Localize Fine-Grained AI-Edited Images?