Malicious Image Analysis via Vision-Language Segmentation Fusion: Detection, Element, and Location in One-shot
Not on the map. Why?
Abstract (arXiv)
Detecting illicit visual content demands more than image-level NSFW flags; moderators must also know what objects make an image illegal and where those objects occur. We introduce a zero-shot pipeline that simultaneously (i) detects if an image contains harmful content, (ii) identifies each critical element involved, and (iii) localizes those elements with pixel-accurate masks - all in one pass. The system first applies foundation segmentation model (SAM) to generate candidate object masks and refines them into larger independent regions. Each region is scored for malicious relevance by a vision-language model using open-vocabulary prompts; these scores weight a fusion step that produces a consolidated malicious object map. An ensemble across multiple segmenters hardens the pipeline against adaptive attacks that target any single segmentation method. Evaluated on a newly-annotated 790-image dataset spanning drug, sexual, violent and extremist content, our method attains 85.8% element-level recall, 78.1% precision and a 92.1% segment-success rate - exceeding direct zero-shot VLM localization by 27.4% recall at comparable precision. Against PGD adversarial perturbations crafted to break SAM and VLM, our method's precision and recall decreased by no more than 10%, demonstrating high robustness against attacks. The full pipeline processes an image in seconds, plugs seamlessly into existing VLM workflows, and constitutes the first practical tool for fine-grained, explainable malicious-image moderation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
31 of 37 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2023Segment Anythingcited by 8,158
- 2017Mask R-CNNcited by 7,259
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
19 more
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2019Attention is not not Explanationcited by 629
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 260
- 2017Learning to Detect Human-Object Interactionscited by 238
- 2023Image Hijacks: Adversarial Images can Control Generative Models at Runtimecited by 165
- 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 85
- 2024LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoningcited by 52
- 2023Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detectioncited by 45
- 2024From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Taskscited by 37
- 2018Hide-and-Seek: A Data Augmentation Technique for Weakly-Supervised Localization and Beyondcited by 36
- 2024DarkSAM: Fooling Segment Anything Model to Segment Nothingcited by 32
- 2025Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Modelscited by 29
- 2024Transferable Adversarial Attacks on SAM and Its Downstream Modelscited by 20
- 2024Moderating Illicit Online Image Promotion for Unsafe User-Generated Content Games Using Large Vision-Language Modelscited by 13
- 2024T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognitioncited by 10
- 2023Attack-SAM: Towards Attacking Segment Anything Model With Adversarial Examplescited by 5
- 2025VModA: An Effective Framework for Adaptive NSFW Image Moderationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DE-FIVE: Detecting Malicious Image Prompts via Fourier Features and Image Vector Embeddings
- 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tampering
- 2026Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs
- 2025Zero-Shot Defense Against Toxic Images via Inherent Multimodal Alignment in LVLMs
- 2025AutoDebias: Automated Framework for Debiasing Text-to-Image Models
- 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization
- 2025Contextual Image Attack: How Visual Context Exposes Multimodal Safety Vulnerabilities
- 2024Perturb and Recover: Fine-tuning for Effective Backdoor Removal from CLIP