Forensic-Aware Continual Adaptation for Image Forgery Localization
Not on the map. Why?
Abstract (arXiv)
The rapid evolution of image manipulation techniques has raised growing public security concerns. Existing Image Forgery Localization (IFL) methods can accurately localize manipulated regions but are often unable to adapt to newly emerging forgeries. In real-world forensic scenarios, data typically arrive sequentially, yet continual model adaptation remains largely unexplored in IFL. To bridge this gap, we introduce the first continual learning framework for IFL and establish a comprehensive benchmark under two realistic data-evolution protocols: cross-dataset and cross-content continual learning. Evaluations of representative state-of-the-art IFL and continual learning methods reveal substantial performance degradation, highlighting two key challenges: (1) adaptively capturing intrinsic forensic traces from incoming data across unseen domains, and (2) preserving previously acquired forensic knowledge during sequential adaptation. To address these challenges, we propose a forensic-aware continual adaptation framework. First, a forensic trace mining module employs Spatial Mixture-of-Forensic-Experts (SMoFE) to dynamically route complementary forensic cues across spatial locations, together with Forensic Evidence-Guided Dense Prompting (FEGDP) to transform low-level forensic traces into structured localization evidence for SAM. Second, Fisher-weighted LoRA Gradient (FLAG) surgery identifies old-task-sensitive adaptation directions and suppresses conflicting updates, mitigating catastrophic forgetting while preserving plasticity for emerging forgery domains. Extensive experiments demonstrate state-of-the-art performance in both pixel-level forgery localization and image-level forgery detection across diverse continual learning scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 75 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
31 of 75 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2021Learning to Prompt for Continual Learningcited by 944
- 2022S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learningcited by 246
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2019Incremental learning for the detection and classification of GAN-generated imagescited by 58
- 2024Consistent Prompting for Rehearsal-Free Continual Learningcited by 54
19 more
- 2024Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learningcited by 53
- 2021Detection and Continual Learning of Novel Face Presentation Attackscited by 33
- 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
- 2023Continual Face Forgery Detection via Historical Distribution Preservingcited by 23
- 2024ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuningcited by 20
- 2024SAFIRE: Segment Any Forged Image Regioncited by 18
- 2024Stacking Brick by Brick: Aligned Feature Isolation for Incremental Face Forgery Detectioncited by 16
- 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
- 2023Rehearsal-Free Domain Continual Face Anti-Spoofing: Generalize More and Forget Lesscited by 12
- 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detectioncited by 11
- 2021BioFors: A Large Biomedical Image Forensics Datasetcited by 8
- 2025ForensicsSAM: Toward Robust and Unified Image Forgery Detection and Localization Resisting to Adversarial Attackcited by 6
- 2026IDER: IDempotent Experience Replay for Reliable Continual Learningcited by 4
- 2023Exposing Image Splicing Traces in Scientific Publications via Uncertainty-guided Refinementcited by 3
- 2024Dense Feature Interaction Network for Image Inpainting Localizationcited by 3
- 2026Detecting AI-Generated Forgeries via Iterative Manifold Deviation Amplificationcited by 3
- 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representationcited by 3
- 2021Benchmarking Scientific Image Forgery Detectorscited by 2
- 2025Learning with Preserving for Continual Multitask Learningcited by 1
Built on by
Not cited yet.