OmniAD: Detect and Understand Industrial Anomaly via Multimodal Reasoning
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
While anomaly detection has made significant progress, generating detailed analyses that incorporate industrial knowledge remains a challenge. To address this gap, we introduce OmniAD, a novel framework that unifies anomaly detection and understanding for fine-grained analysis. OmniAD is a multimodal reasoner that combines visual and textual reasoning processes. The visual reasoning provides detailed inspection by leveraging Text-as-Mask Encoding to perform anomaly detection through text generation without manually selected thresholds. Following this, Visual Guided Textual Reasoning conducts comprehensive analysis by integrating visual perception. To enhance few-shot generalization, we employ an integrated training strategy that combines supervised fine-tuning (SFT) with reinforcement learning (GRPO), incorporating three sophisticated reward functions. Experimental results demonstrate that OmniAD achieves a performance of 79.1 on the MMAD benchmark, surpassing models such as Qwen2.5-VL-7B and GPT-4o. It also shows strong results across multiple anomaly detection benchmarks. These results highlight the importance of enhancing visual perception for effective reasoning in anomaly understanding. All codes and models will be publicly available.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 27 of its 59 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
27 of 59 references.
Closest ancestors · 2
Same direction, newest first
- 2025LAD-Reasoner: Tiny Multimodal Models are Good Reasoners for Logical Anomaly Detection17 Apr
- 2025AnomalyR1: A GRPO-based End-to-end MLLM for Industrial Anomaly Detection16 Apr
Other references · 25
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024OpenAI o1 System Cardcited by 1,220
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 234
- 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domainscited by 150
13 more
- 2024MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detectioncited by 113
- 2024Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detectioncited by 92
- 2025AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIPcited by 72
- 2023Segment Any Anomaly without Training via Hybrid Prompt Regularizationcited by 59
- 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 59
- 2023DiffusionAD: Norm-guided One-step Denoising Diffusion for Anomaly Detectioncited by 46
- 2023Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Leadcited by 40
- 2023Myriad: Large Multimodal Model by Applying Vision Experts for Industrial Anomaly Detectioncited by 39
- 2024UniVAD: A Training-free Unified Model for Few-shot Visual Anomaly Detectioncited by 28
- 2025Can Multimodal Large Language Models be Guided to Improve Industrial Anomaly Detection?cited by 17
- 2024Salvaging the Overlooked: Leveraging Class-Aware Contrastive Learning for Multi-Class Anomaly Detectioncited by 15
- 20253CAD: A Large-Scale Real-World 3C Product Dataset for Unsupervised Anomalycited by 10
- 2025Triad: Empowering LMM-based Anomaly Detection with Vision Expert-guided Visual Tokenizer and Manufacturing Processcited by 8
Built on by
Citing papers per year: 2025: 4; 2026: 14.
18 papers.
Sort:
By area:
- 2025EMIT: Enhancing MLLMs for Industrial Anomaly Detection via Difficulty-Aware GRPOcited by 11
- 2025AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimizationcited by 8
- 2026AD-Copilot: A Vision-Language Assistant for Industrial Anomaly Detection via Visual In-context Comparisoncited by 5
- 2025AgentIAD: Agentic Industrial Anomaly Detection via Adaptive Memory Augmentationcited by 4
- 2026JUDO: A Juxtaposed Domain-Oriented Multimodal Reasoner for Industrial Anomaly QAcited by 4
- 2026Reasoning-Driven Anomaly Detection and Localization with Image-Level Supervisioncited by 3
- 2026EAGLE: Expert-Augmented Attention Guidance for Tuning-Free Industrial Anomaly Detection in Multimodal Large Language Modelscited by 2
- 2026IAD-Unify: Task-Specific Interfaces for Industrial Anomaly Understanding, Segmentation, and Generationcited by 2
- 2025ABounD: Adversarial Boundary-Driven Few-Shot Learning for Multi-Class Anomaly Detectioncited by 1
- 2026UniPCB: A Unified Vision-Language Benchmark for Open-Ended PCB Quality Inspectioncited by 1
- 2026M3-AD: Reflection-aware Multi-modal, Multi-category, and Multi-dimensional Benchmark and Framework for Industrial Anomaly Detectioncited by 1
- 2026DifferAD-R1: A Difference-Guided IndustrialAnomaly Localization with Multimodal LargeLanguage Modelscited by 0
6 more
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detectioncited by 0
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoningcited by 0
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Spacecited by 0
- 2026TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localizationcited by 0
- 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?cited by 0
- 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?8 Oct 2026
- 2026TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localization30 Sep 2026
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space24 Sep 2026
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning20 Jul 2026
- 2026Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detection4 Jul 2026
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026DifferAD-R1: A Difference-Guided IndustrialAnomaly Localization with Multimodal LargeLanguage Models15 Jun 2026
- 2026JUDO: A Juxtaposed Domain-Oriented Multimodal Reasoner for Industrial Anomaly QA19 May 2026
- 2026IAD-Unify: Task-Specific Interfaces for Industrial Anomaly Understanding, Segmentation, and Generation14 Apr 2026
- 2026Reasoning-Driven Anomaly Detection and Localization with Image-Level Supervision28 Mar 2026
- 2026AD-Copilot: A Vision-Language Assistant for Industrial Anomaly Detection via Visual In-context Comparison14 Mar 2026
- 2026EAGLE: Expert-Augmented Attention Guidance for Tuning-Free Industrial Anomaly Detection in Multimodal Large Language Models19 Feb 2026
6 more
- 2026M3-AD: Reflection-aware Multi-modal, Multi-category, and Multi-dimensional Benchmark and Framework for Industrial Anomaly Detection10 Feb 2026
- 2026UniPCB: A Unified Vision-Language Benchmark for Open-Ended PCB Quality Inspection27 Jan 2026
- 2025AgentIAD: Agentic Industrial Anomaly Detection via Adaptive Memory Augmentation15 Dec 2025
- 2025ABounD: Adversarial Boundary-Driven Few-Shot Learning for Multi-Class Anomaly Detection27 Nov 2025
- 2025AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimization6 Aug 2025
- 2025EMIT: Enhancing MLLMs for Industrial Anomaly Detection via Difficulty-Aware GRPO29 Jul 2025
- 2026AD-Copilot: A Vision-Language Assistant for Industrial Anomaly Detection via Visual In-context Comparisoncited by 5
- 2026JUDO: A Juxtaposed Domain-Oriented Multimodal Reasoner for Industrial Anomaly QAcited by 4
- 2026EAGLE: Expert-Augmented Attention Guidance for Tuning-Free Industrial Anomaly Detection in Multimodal Large Language Modelscited by 2
- 2026UniPCB: A Unified Vision-Language Benchmark for Open-Ended PCB Quality Inspectioncited by 1
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detectioncited by 0
- 2026TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localizationcited by 0
- 2026TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localization30 Sep 2026
- 2026Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detection4 Jul 2026
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026JUDO: A Juxtaposed Domain-Oriented Multimodal Reasoner for Industrial Anomaly QA19 May 2026
- 2026AD-Copilot: A Vision-Language Assistant for Industrial Anomaly Detection via Visual In-context Comparison14 Mar 2026
- 2026EAGLE: Expert-Augmented Attention Guidance for Tuning-Free Industrial Anomaly Detection in Multimodal Large Language Models19 Feb 2026
- 2026UniPCB: A Unified Vision-Language Benchmark for Open-Ended PCB Quality Inspection27 Jan 2026
- 2025EMIT: Enhancing MLLMs for Industrial Anomaly Detection via Difficulty-Aware GRPOcited by 11
- 2025AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimizationcited by 8
- 2026Reasoning-Driven Anomaly Detection and Localization with Image-Level Supervisioncited by 3
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Spacecited by 0
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space24 Sep 2026
- 2026Reasoning-Driven Anomaly Detection and Localization with Image-Level Supervision28 Mar 2026
- 2025AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimization6 Aug 2025
- 2025EMIT: Enhancing MLLMs for Industrial Anomaly Detection via Difficulty-Aware GRPO29 Jul 2025
- 2026IAD-Unify: Task-Specific Interfaces for Industrial Anomaly Understanding, Segmentation, and Generationcited by 2
- 2025ABounD: Adversarial Boundary-Driven Few-Shot Learning for Multi-Class Anomaly Detectioncited by 1
- 2026M3-AD: Reflection-aware Multi-modal, Multi-category, and Multi-dimensional Benchmark and Framework for Industrial Anomaly Detectioncited by 1
- 2026DifferAD-R1: A Difference-Guided IndustrialAnomaly Localization with Multimodal LargeLanguage Modelscited by 0
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoningcited by 0
- 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?cited by 0
- 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?8 Oct 2026
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning20 Jul 2026
- 2026DifferAD-R1: A Difference-Guided IndustrialAnomaly Localization with Multimodal LargeLanguage Models15 Jun 2026
- 2026IAD-Unify: Task-Specific Interfaces for Industrial Anomaly Understanding, Segmentation, and Generation14 Apr 2026
- 2026M3-AD: Reflection-aware Multi-modal, Multi-category, and Multi-dimensional Benchmark and Framework for Industrial Anomaly Detection10 Feb 2026
- 2025ABounD: Adversarial Boundary-Driven Few-Shot Learning for Multi-Class Anomaly Detection27 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Tools
- 2026Towards Explainable Industrial Anomaly Detection via Knowledge-Guided Latent Reasoning
- 2024Customizing Visual-Language Foundation Models for Multi-modal Anomaly Detection and Reasoning
- 2024VMAD: Visual-enhanced Multimodal Large Language Model for Zero-Shot Anomaly Detection
- 2025SAGE: A Visual Language Model for Anomaly Detection via Fact Enhancement and Entropy-aware Alignment
- 2025IAD-R1: Reinforcing Consistent Reasoning in Industrial Anomaly Detection
- 2026A Structured Benchmark for Text-Guided Anomaly Detection: When Language Stops Conditioning the Decision
- 2026InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection