Safe Alone, Unsafe Together: Safeguarding Against Implicit Toxicity When Benign Images Combine
Not on the map. Why?
Abstract (arXiv)
Multi-image content has become an increasingly prevalent form of visual communication in social media, giving rise to a new safety issue, multi-image implicit toxicity (MIIT), where each image appears benign in isolation, but harmful semantics emerge when the images are interpreted jointly. MIIT is particularly challenging for existing commercial moderation APIs and models due to the lack of explicit risky cues in each image. This paper aims to study how to identify MIIT. We first provide a formal definition of MIIT and analyze three key challenges for its detection. To alleviate the scarcity of data in this area, we construct MIIT-dataset, an image-only multi-image safety dataset covering seven representative risk categories through an automatic generation pipeline. Finally, we train MiShield with progressively distilled reasoning supervision, enabling it to produce safety judgments accompanied by explicit analyses of the correlated entities that result in the hazards. Experiments show that MiShield-8B models outperform representative moderation services and even larger-scale models, revealing its effectiveness and practical value for this widely used visual format. Warning: This paper contains potentially sensitive content.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 39 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
14 of 39 references.
References · 14
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
- 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelscited by 67
- 2024VLSBench: Unveiling Visual Leakage in Multimodal Safetycited by 63
- 2024LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Modelscited by 52
- 2025Safe RLHF-V: Safe Reinforcement Learning from Multi-modal Human Feedbackcited by 30
- 2025MiCo: Multi-image Contrast for Reinforcement Visual Reasoningcited by 9
- 2026MMR-Life: Piecing Together Real-life Scenes for Multimodal Multi-image Reasoningcited by 9
- 2024A Collaborative Content Moderation Framework for Toxicity Detection based on Conformalized Estimates of Annotation Disagreementcited by 3
- 2025Scaling Reinforcement Learning for Content Moderation with Large Language Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ShieldVLM: Safeguarding the Multimodal Implicit Toxicity via Deliberative Reasoning with LVLMs
- 2024Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes
- 2025Understanding and Mitigating Toxicity in Image-Text Pretraining Datasets: A Case Study on LLaVA
- 2025T2I-RiskyPrompt: A Benchmark for Safety Evaluation, Attack, and Defense on Text-to-Image Model
- 2025MDIT-Bench: Evaluating the Dual-Implicit Toxicity in Large Multimodal Models
- 2025SafetyPairs: Isolating Safety Critical Image Features with Counterfactual Image Generation
- 2025Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Study
- 2026Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed