mlsanityData to 14 Oct 2026

Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs

arXiv 2607.18230 ↗First posted 20 Jul 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cross-model and out-of-distribution shifts. This work studies domain generalization for pixel-level image tampering detection in modern VLMs like ChatGPT, Gemini, Qwen-Image, etc., aiming to learn tampering localization models that remain robust across diverse VLM-generated manipulation distributions. We propose a simple yet effective domain-generalized training framework built on two practical strategies. First, we introduce a balanced minibatch sampling scheme that strategically samples tampered and real images in each minibatch, preventing biased optimization toward either manipulated artifacts or clean-image priors and avoiding training collapse, ensuring that each optimization step receives proper sampled gradient signals. Second, we adopt a simple late-injection strategy, where the detector is first trained on large-scale base data until stable convergence, and then exposed to a small amount of newly selected supporting data from emerging VLM distributions, improving adaptability without overfitting to limited new domains. Together, these components provide a simple yet strong recipe for improving pixel-level tampering localization and OOD robustness across modern VLMs. Despite the conceptual simplicity, our framework outperforms the prior state-of-the-art PIXAR by a large margin of 26.1% and 26.8% relative improvement in average gIoU and cIoU, respectively, across OOD VLMs of GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5. Our code is available at https://github.com/VILA-Lab/PIXAR-DG

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 29 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

18 of 29 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec
  2. 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors26 Oct

Other references · 16

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  2. 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
  3. 2020In Search of Lost Domain Generalizationcited by 1,054
  4. 2025Qwen-Image Technical Reportcited by 1,044
  5. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  6. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  7. 2021Domain Generalization: A Surveycited by 764
  8. 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
  9. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  10. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
  11. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  12. 2021Simple data balancing achieves competitive worst-group-accuracycited by 178
4 more
  1. 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 154
  2. 2022Domain Generalization by Mutual-Information Regularization with Pre-trained Modelscited by 133
  3. 2024Lipsum-FT: Robust Fine-Tuning of Zero-Shot Models Using Random Text Guidancecited by 14
  4. 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tamperingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking VLMs for Image Forgery Detection and Localization
  2. 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline
  3. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models
  4. 2026DE-FIVE: Detecting Malicious Image Prompts via Fourier Features and Image Vector Embeddings
  5. 2025Training-Free In-Context Forensic Chain for Image Manipulation Detection and Localization
  6. 2024MVTamperBench: Evaluating Robustness of Vision-Language Models
  7. 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization
  8. 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models