GAP-SAM: A Global Artifact Prior for Generalizable AI-Generated Image Manipulation Localization
Not on the map. Why?
Abstract (arXiv)
AI-generated image manipulation localization identifies edited pixels, but its OOD performance lags behind image-level detection partly because pixel supervision entangles forensic evidence with dataset-specific mask geometry and semantic boundaries. Extending image-level distribution alignment to localization, we construct COCO-ControlNet with source-image Canny edges and depth maps to align semantics and geometry, improving OOD performance across multiple localizers. Yet tighter Mask-VAE Reconstruction Alignment (Mask-VAE) underperforms COCO-ControlNet, showing that VAE reconstruction artifacts transfer poorly to local diffusion-inpainting artifacts. We also identify boundary adhesion, where fine-tuned segmentation models snap predictions to semantic object contours rather than true manipulation boundaries. These findings motivate GAP-SAM, which encodes an image and its frozen VAE reconstruction into a global artifact token and injects it into SAM3's feature pyramid via zero-gated FiLM before pixel decoding. Without prescribing a spatial region, this token modulates dense decoding to preserve localization while suppressing semantic-boundary shortcuts. Across six datasets, GAP-SAM averages 79.8 Pixel-F1, outperforming the strongest prior method by 12.6 points. It also performs best at every tested severity of JPEG compression, Gaussian blur, and resizing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 38 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
18 of 38 references.
References · 18
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
- 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
- 2024Fake or JPEG? Revealing Common Biases in Generated Image Detection Datasetscited by 43
- 2024Aligned Datasets Improve Detection of Latent Diffusion-Generated Imagescited by 36
6 more
- 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localizationcited by 35
- 2021TransForensics: Image Forgery Localization with Dense Self-Attentioncited by 26
- 2023Rethinking Image Editing Detection in the Era of Generative AI Revolutioncited by 21
- 2024SAFIRE: Segment Any Forged Image Regioncited by 18
- 2025Revisiting Image Manipulation Localization under Realistic Manipulation Scenarioscited by 3
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
Built on by
Not cited yet.