mlsanityData to 14 Oct 2026

Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models

arXiv 2606.15880 ↗First posted 14 Jun 2026cs.CV cs.AIcited by 3

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Multimodal large language models (MLLMs) have been increasingly adopted in forensics for their robust semantic understanding. As AI-generated images become realistic, semantic-level inconsistencies alone are often insufficient for reliable detection. This motivates a critical question: whether MLLMs can achieve full-spectrum forensic signal perception, i.e., capturing low-level generator artifacts without sacrificing pre-trained semantic knowledge. We further perform a layer-wise analysis of forensic signal perception in MLLMs, showing that semantic information is primarily formed in the early-to-middle layers, whereas direct fine-tuning for artifact learning disrupts these semantic representations. Based on this insight, we propose Deep Visual Residual MLLM (Deep-VRM) to preserve early semantic processing while injecting artifact-specific visual signals as a residual path into an intermediate layer, where they are fused with semantic token representations and propagated through subsequent trainable layers. This enables later layers to jointly model semantic reasoning and signal-level forensic cues, and surprisingly, the model learns to adaptively leverage different levels of forensic signals depending on the input, achieving robust and generalizable detection performance. Extensive experiments show that our method achieves state-of-the-art across most benchmarks. The code and data are available at https://github.com/KQL11/Deep-VRM.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 53 of its 65 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

53 of 65 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection29 Sep
  2. 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanation19 Mar
  3. 2024Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detection4 Sep
  4. 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics21 Mar

Other references · 49

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  8. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  9. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  10. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  11. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  12. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
37 more
  1. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  2. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  3. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  4. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  5. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  6. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
  7. 2024Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lenscited by 143
  8. 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
  9. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
  10. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
  11. 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 89
  12. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  13. 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
  14. 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 57
  15. 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
  16. 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 51
  17. 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
  18. 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Errorcited by 47
  19. 2025CO-SPY: Combining Semantic and Pixel Features to Detect Synthetic Images by AIcited by 42
  20. 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
  21. 2025Breaking Latent Prior Bias in Detectors for Generalizable AIGC Image Detectioncited by 16
  22. 2025MLLM-Enhanced Face Forgery Detection: A Vision-Language Fusion Solutioncited by 15
  23. 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detectioncited by 11
  24. 2025Beyond Artifacts: Real-Centric Envelope Modeling for Reliable AI-Generated Image Detectioncited by 11
  25. 2026MIRROR: Manifold Ideal Reference ReconstructOR for Generalizable AI-Generated Image Detectioncited by 11
  26. 2025NS-Net: Decoupling CLIP Semantic Information through NULL-Space for Generalizable AI-Generated Image Detectioncited by 8
  27. 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
  28. 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Modelscited by 7
  29. 2025AvatarShield: Visual Reinforcement Learning for Human-Centric Synthetic Video Detectioncited by 6
  30. 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
  31. 2025PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detectioncited by 5
  32. 2025DINO-Detect: A Simple yet Effective Framework for Blur-Robust AI-Generated Image Detectioncited by 5
  33. 2025DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detectioncited by 5
  34. 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignmentcited by 4
  35. 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detectioncited by 3
  36. 2026Quality-Aware Calibration for AI-Generated Image Detection in the Wildcited by 2
  37. 2025Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025FORGE: Forensic Reasoning with Grounded Evidence
  2. 2025INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts
  3. 2026ForensicZip: More Tokens are Better but Not Necessary in Forensic Vision-Language Models
  4. 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
  5. 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection
  6. 2026ForensicZoom: Adaptive Visual Inspection with Multimodal LLMs for Industrial-Grade Face Forgery Detection
  7. 2026V-Reflection: Transforming MLLMs from Passive Observers to Active Interrogators
  8. 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models