mlsanityData to 7 Oct 2026

Off-the-shelf Vision Models Benefit Image Manipulation Localization

arXiv 2604.09096 ↗First posted 10 Apr 2026cs.CV cs.MM eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Image manipulation localization (IML) and general vision tasks are typically treated as two separate research directions due to the fundamental differences between manipulation-specific and semantic features. In this paper, however, we bridge this gap by introducing a fresh perspective: these two directions are intrinsically connected, and general semantic priors can benefit IML. Building on this insight, we propose a novel trainable adapter (named ReVi) that repurposes existing off-the-shelf general-purpose vision models (e.g., image generation and segmentation networks) for IML. Inspired by robust principal component analysis, the adapter disentangles semantic redundancy from manipulation-specific information embedded in these models and selectively enhances the latter. Unlike existing IML methods that require extensive model redesign and full retraining, our method relies on the off-the-shelf vision models with frozen parameters and only fine-tunes the proposed adapter. The experimental results demonstrate the superiority of our method, showing the potential for scalable IML frameworks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

29 of 60 references.

References · 29

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2023Segment Anythingcited by 8,158
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  8. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  9. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  10. 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
  11. 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 113
  12. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
17 more
  1. 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
  2. 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
  3. 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detectioncited by 43
  4. 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 42
  5. 2021ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensingcited by 39
  6. 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localizationcited by 35
  7. 2024Frequency-Adaptive Dilated Convolution for Semantic Segmentationcited by 34
  8. 2023TinySAM: Pushing the Envelope for Efficient Segment Anything Modelcited by 33
  9. 2021BridgeNet: A Joint Learning Network of Depth Map Super-Resolution and Monocular Depth Estimationcited by 31
  10. 2024Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Modelscited by 31
  11. 2024Can We Get Rid of Handcrafted Feature Extractors? SparseViT: Nonsemantics-Centered, Parameter-Efficient Image Manipulation Localization through Spare-Coding Transformercited by 29
  12. 2024SAFIRE: Segment Any Forged Image Regioncited by 18
  13. 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
  14. 2024Advancing Multimodal Large Language Models with Quantization-Aware Scale Learning for Efficient Adaptationcited by 15
  15. 2025RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentationcited by 11
  16. 2024Harmfully Manipulated Images Matter in Multimodal Misinformation Detectioncited by 9
  17. 2025ForensicsSAM: Toward Robust and Unified Image Forgery Detection and Localization Resisting to Adversarial Attackcited by 6

Built on by

Not cited yet.