mlsanityData to 14 Oct 2026

Semantic Manipulation Localization

arXiv 2604.10132 ↗First posted 11 Apr 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Image Manipulation Localization (IML) aims to identify edited regions in an image. However, with the increasing use of modern image editing and generative models, many manipulations no longer exhibit obvious low-level artifacts. Instead, they often involve subtle but meaning-altering edits to an object's attributes, state, or relationships while remaining highly consistent with the surrounding content. This makes conventional IML methods less effective because they mainly rely on artifact detection rather than semantic sensitivity. To address this issue, we introduce Semantic Manipulation Localization (SML), a new task that focuses on localizing subtle semantic edits that significantly change image interpretation. We further construct a dedicated fine-grained benchmark for SML using a semantics-driven manipulation pipeline with pixel-level annotations. Based on this task, we propose TRACE (Targeted Reasoning of Attributed Cognitive Edits), an end-to-end framework that models semantic sensitivity through three progressively coupled components: semantic anchoring, semantic perturbation sensing, and semantic-constrained reasoning. Specifically, TRACE first identifies semantically meaningful regions that support image understanding, then injects perturbation-sensitive frequency cues to capture subtle edits under strong visual consistency, and finally verifies candidate regions through joint reasoning over semantic content and semantic scope. Extensive experiments show that TRACE consistently outperforms existing IML methods on our benchmark and produces more complete, compact, and semantically coherent localization results. These results demonstrate the necessity of moving beyond artifact-based localization and provide a new direction for image forensics in complex semantic editing scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 11 Apr 2026.

Builds on

30 of 49 references.

References · 30

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2025SAM 3: Segment Anything with Conceptscited by 906
  4. 2021ClipCap: CLIP Prefix for Image Captioningcited by 559
  5. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
  6. 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 212
  7. 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
  8. 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
  9. 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
  10. 2014Salient Object Detection: A Discriminative Regional Feature Integration Approachcited by 89
  11. 2024SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentationcited by 64
  12. 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
18 more
  1. 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localizationcited by 22
  2. 2022UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialogcited by 19
  3. 2024SAFIRE: Segment Any Forged Image Regioncited by 18
  4. 2022Making DeepFakes more spurious: evading deep face forgery detection via trace removal attackcited by 16
  5. 2023Effective Image Tampering Localization via Enhanced Transformer and Co-attention Fusioncited by 15
  6. 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
  7. 2022CFL-Net: Image Forgery Localization Using Contrastive Learningcited by 12
  8. 2023Rethinking Image Forgery Detection via Soft Contrastive Learning and Unsupervised Clusteringcited by 12
  9. 2021Unifying Global-Local Representations in Salient Object Detection with Transformercited by 11
  10. 2025SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentationcited by 7
  11. 2025M2SFormer: Multi-Spectral and Multi-Scale Attention with Edge-Aware Difficulty Guidance for Image Forgery Localizationcited by 6
  12. 2022ReLoc: A Restoration-Assisted Framework for Robust Image Tampering Localizationcited by 5
  13. 2023MMFusion: Combining Image Forensic Filters for Visual Manipulation Detection and Localizationcited by 5
  14. 2024CONDA: Condensed Deep Association Learning for Co-Salient Object Detectioncited by 4
  15. 2025Uncertainty Guided Refinement for Fine-Grained Salient Object Detectioncited by 4
  16. 2022Dual Swin-Transformer based Mutual Interactive Network for RGB-D Salient Object Detectioncited by 3
  17. 2023Adversarial Examples Detection with Enhanced Image Difference Features based on Local Histogram Equalizationcited by 1
  18. 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.