mlsanityData to 14 Oct 2026

Adaptive Forensic Feature Refinement via Intrinsic Importance Perception

arXiv 2604.16879 ↗First posted 18 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

With the rapid development of generative models and multimodal content editing technologies, the key challenge faced by synthetic image detection (SID) lies in cross-distribution generalization to unknown generation sources. In recent years, visual foundation models (VFM), which acquire rich visual priors through large scale image-text alignment pretraining, have become a promising technical route for improving the generalization ability of SID. However, existing VFM-based methods remain relatively coarse-grained in their adaptation strategies. They typically either directly use the final layer representations of VFM or simply fuse multi layer features, lacking explicit modeling of the optimal representational hierarchy for transferable forgery cues. Meanwhile, although directly fine-tuning VFM can enhance task adaptation, it may also damage the cross-modal pretrained structure that supports open-set generalization. To address this task specific tension, we reformulate VFM adaptation for SID as a joint optimization problem: it is necessary both to identify the critical representational layer that is more suitable for carrying forgery discriminative information and to constrain the disturbance caused by task knowledge injection to the pretrained structure. Based on this, we propose I2P, an SID framework centered on intrinsic importance perception. I2P first adaptively identifies the critical layer representations that are most discriminative for SID, and then constrains task-driven parameter updates within a low sensitivity parameter subspace, thereby improving task specificity while preserving the transferable structure of pretrained representations as much as possible.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 59 references that are in the map. First posted on arXiv 18 Apr 2026.

Builds on

19 of 59 references.

References · 19

  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  3. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  4. 2025DINOv3cited by 1,414
  5. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  6. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
  7. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
  8. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  9. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
  10. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  11. 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
  12. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
7 more
  1. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 85
  2. 2024Progressive Knowledge Distillation Of Stable Diffusion XL Using Layer Level Losscited by 52
  3. 2024A Single Simple Patch is All You Need for AI-generated Image Detectioncited by 44
  4. 2025Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Modelcited by 16
  5. 2024ForgeLens: Data-Efficient Forgery Focus for Generalizable Forgery Image Detectioncited by 15
  6. 2025FerretNet: Efficient Synthetic Image Detection via Local Pixel Dependenciescited by 12
  7. 2025Mysteries of the Deep: Role of Intermediate Representations in Out of Distribution Detectioncited by 7

Built on by

Not cited yet.