ZSG-IAD: A Multimodal Framework for Zero-Shot Grounded Industrial Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Deep learning-based industrial anomaly detectors often behave as black boxes, making it hard to justify decisions with physically meaningful defect evidence. We propose ZSG-IAD, a multimodal vision-language framework for zero-shot grounded industrial anomaly detection. Given RGB images, sensor images, and 3D point clouds, ZSG-IAD generates structured anomaly reports and pixel-level anomaly masks. ZSG-IAD introduces a language-guided two-hop grounding module: (1) anomaly-related sentences select evidence-like latent slots distilled from multimodal features, yielding coarse spatial support; (2) selected slots modulate feature maps via channel-spatial gating and a lightweight decoder to produce fine-grained masks. To improve reliability, we further apply Executable-Rule GRPO with verifiable rewards to promote structured outputs, anomaly-region consistency, and reasoning-conclusion coherence. Experiments across multiple industrial anomaly benchmarks show strong zero-shot performance and more transparent, physically grounded explanations than prior methods. We will release code and annotations to support future research on trustworthy industrial anomaly detection systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
34 of 40 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2024GPT-4o System Cardcited by 4,467
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
22 more
- 2020Point Transformercited by 1,462
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
- 2015Towards Open Set Deep Networkscited by 533
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 530
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2021Image Segmentation Using Text and Image Promptscited by 509
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
- 2024What matters when building vision-language models?cited by 321
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 311
- 2018Recent Advances in Open Set Recognition: A Surveycited by 309
- 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 225
- 2021The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localizationcited by 174
- 2023EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latenciescited by 157
- 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 139
- 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 138
- 2025AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIPcited by 72
- 2022The Eyecandies Dataset for Unsupervised Multimodal Anomaly Detection and Localizationcited by 55
- 2024Multi-Sensor Object Anomaly Detection: Unifying Appearance, Geometry, and Internal Propertiescited by 26
- 2025Real-IAD D3: A Real-World 2D/Pseudo-3D/3D Dataset for Industrial Anomaly Detectioncited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024VMAD: Visual-enhanced Multimodal Large Language Model for Zero-Shot Anomaly Detection
- 2025IADGPT: Unified LVLM for Few-Shot Industrial Anomaly Detection, Localization, and Reasoning via In-Context Learning
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models
- 2025IAD-GPT: Advancing Visual Knowledge in Multimodal Large Language Model for Industrial Anomaly Detection
- 2026Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detection
- 2026AD-Copilot: A Vision-Language Assistant for Industrial Anomaly Detection via Visual In-context Comparison
- 2026A Structured Benchmark for Text-Guided Anomaly Detection: When Language Stops Conditioning the Decision