Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cross-model and out-of-distribution shifts. This work studies domain generalization for pixel-level image tampering detection in modern VLMs like ChatGPT, Gemini, Qwen-Image, etc., aiming to learn tampering localization models that remain robust across diverse VLM-generated manipulation distributions. We propose a simple yet effective domain-generalized training framework built on two practical strategies. First, we introduce a balanced minibatch sampling scheme that strategically samples tampered and real images in each minibatch, preventing biased optimization toward either manipulated artifacts or clean-image priors and avoiding training collapse, ensuring that each optimization step receives proper sampled gradient signals. Second, we adopt a simple late-injection strategy, where the detector is first trained on large-scale base data until stable convergence, and then exposed to a small amount of newly selected supporting data from emerging VLM distributions, improving adaptability without overfitting to limited new domains. Together, these components provide a simple yet strong recipe for improving pixel-level tampering localization and OOD robustness across modern VLMs. Despite the conceptual simplicity, our framework outperforms the prior state-of-the-art PIXAR by a large margin of 26.1% and 26.8% relative improvement in average gIoU and cIoU, respectively, across OOD VLMs of GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5. Our code is available at https://github.com/VILA-Lab/PIXAR-DG
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 29 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
18 of 29 references.
Closest ancestors · 2
Same direction, newest first
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors26 Oct
Other references · 16
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
- 2020In Search of Lost Domain Generalizationcited by 1,054
- 2025Qwen-Image Technical Reportcited by 1,044
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2021Domain Generalization: A Surveycited by 764
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2021Simple data balancing achieves competitive worst-group-accuracycited by 178
4 more
- 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 154
- 2022Domain Generalization by Mutual-Information Regularization with Pre-trained Modelscited by 133
- 2024Lipsum-FT: Robust Fine-Tuning of Zero-Shot Models Using Random Text Guidancecited by 14
- 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tamperingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking VLMs for Image Forgery Detection and Localization
- 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models
- 2026DE-FIVE: Detecting Malicious Image Prompts via Fourier Features and Image Vector Embeddings
- 2025Training-Free In-Context Forensic Chain for Image Manipulation Detection and Localization
- 2024MVTamperBench: Evaluating Robustness of Vision-Language Models
- 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization
- 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models