ForensicZip: More Tokens are Better but Not Necessary in Forensic Vision-Language Models
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) enable interpretable multimedia forensics by generating textual rationales for forgery detection. However, processing dense visual sequences incurs high computational costs, particularly for high-resolution images and videos. Visual token pruning is a practical acceleration strategy, yet existing methods are largely semantic-driven, retaining salient objects while discarding background regions where manipulation traces such as high-frequency anomalies and temporal jitters often reside. To address this issue, we introduce ForensicZip, a training-free framework that reformulates token compression from a forgery-driven perspective. ForensicZip models temporal token evolution as a Birth-Death Optimal Transport problem with a slack dummy node, quantifying physical discontinuities indicating transient generative artifacts. The forensic scoring further integrates transport-based novelty with high-frequency priors to separate forensic evidence from semantic content under large-ratio compression. Experiments on deepfake and AIGC benchmarks show that at 10% token retention, ForensicZip achieves 2.97× speedup and over 90% FLOPs reduction while maintaining state-of-the-art detection performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 50 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
24 of 50 references.
Closest ancestors · 3
Same direction, newest first
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanation19 Mar
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models3 Oct
Other references · 21
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2022Token Merging: Your ViT But Fastercited by 995
- 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Modelscited by 394
- 2023MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devicescited by 120
- 2025Beyond Attention or Similarity: Maximizing Conditional Diversity for Token Pruning in MLLMscited by 92
- 2025Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?cited by 76
- 2024AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruningcited by 43
- 2024Filter, Correlate, Compress: Training-Free Token Reduction for MLLM Accelerationcited by 38
9 more
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Modelscited by 32
- 2025LLaVA-Scissor: Token Compression with Semantic Connected Components for Video LLMscited by 25
- 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoningcited by 23
- 2021Deepfake Detection Scheme Based on Vision Transformer and Distillationcited by 22
- 2025Efficient Multi-modal Large Language Models via Progressive Consistency Distillationcited by 22
- 2025Balanced Token Pruning: Accelerating Vision Language Models Beyond Local Optimizationcited by 20
- 2026VisionTrim: Unified Vision Token Compression for Training-Free MLLM Accelerationcited by 16
- 2025Rethinking Visual Token Reduction in LVLMs Under Cross-Modal Misalignmentcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos
- 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
- 2025FORGE: Forensic Reasoning with Grounded Evidence
- 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models
- 2026Beyond Semantic Priors: Mitigating Optimization Collapse for Generalizable Visual Forensics
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization