mlsanityData to 14 Oct 2026

ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization

arXiv 2606.24538 ↗First posted 23 Jun 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Multi-modal Large Language Models (MLLMs) offer powerful reasoning for forensic tasks, yet existing approaches utilizing exogenous segmentation decoders often suffer from suboptimal localization. The reliance on stitched pipelines introduces information bottlenecks during backpropagation, which dilutes spatial signals and is limited by semantic priors of the segmentor. To address these limitations, we propose ForensicsTok, which reformulates image manipulation localization as an autoregressive sequence generation task. ForensicsTok directly generates spatially grounded token sequences, enabling precise mask prediction without intermediary supervision. Specifically, we introduce a Token Splatting Decoder (TSD) to map tokens to binary masks via codebook-aware code smoothing, which mitigates sharp gradients from deterministic detokenizers. Furthermore, to capture diverse tampering clues, we propose a Hierarchical Expert Fusion (HEF) module that injects multi-scale features from a forensic expert model. This unified architecture effectively compensates for the lack of forensic priors in standard MLLMs. Extensive experiments on six benchmarks show that ForensicsTok substantially improves over existing MLLM-based baselines and slightly improves over strong forensic expert baselines, while exhibiting stronger robustness to perturbations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 28 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

18 of 28 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Models3 Jul
  2. 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics16 Apr
  3. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec
  4. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models3 Oct

Other references · 14

  1. 2023Segment Anythingcited by 8,234
  2. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  3. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  4. 2023Segment Everything Everywhere All at Oncecited by 548
  5. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 349
  6. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
  7. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  8. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  9. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
  10. 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
  11. 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
  12. 2024Can We Get Rid of Handcrafted Feature Extractors? SparseViT: Nonsemantics-Centered, Parameter-Efficient Image Manipulation Localization through Spare-Coding Transformercited by 29
2 more
  1. 2025HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal Modelcited by 20
  2. 2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localizationcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Propose and Rectify: A Forensics-Driven MLLM Framework for Image Manipulation Localization
  2. 2025Training-Free In-Context Forensic Chain for Image Manipulation Detection and Localization
  3. 2026ForensicZip: More Tokens are Better but Not Necessary in Forensic Vision-Language Models
  4. 2026Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeries
  5. 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
  6. 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization
  7. 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection
  8. 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline