Multi-Modal Anomaly Detection: A Survey
Not on the map. Why?
Abstract (arXiv)
Multi-Modal Anomaly Detection (MMAD) detects rare abnormal events from heterogeneous data sources and is increasingly used in safety- and reliability-critical applications such as industrial inspection and cybersecurity. Yet the literature is fragmented across domains and modality combinations, and existing surveys usually group methods by architecture rather than by how abnormality is defined and separated in multi-modal settings. We survey MMAD from an assumption-driven perspective. We formalize the problem, identify five intrinsic characteristics underlying its core challenges, and organize prior work into two complementary paradigms. The first, normality-assumption methods, models regularity via representation learning, cross-modal alignment, and knowledge enhancement. The second, anomaly-assumption methods, sharpens decision boundaries through coarse-grained, structural, and semantic anomaly injection. We also investigate how foundation models are reshaping MMAD through scalable pretraining, flexible cross-modal transfer, and emerging reasoning capabilities. Finally, we compile representative benchmarks and evaluation protocols across domains and highlight open problems and future directions for robust, adaptive, and interpretable MMAD systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 119 of its 188 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
119 of 188 references.
References · 119
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Generative Adversarial Networkscited by 5,603
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2017Random Erasing Data Augmentationcited by 1,235
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
38 more
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 407
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 311
- 2019Deep Semi-Supervised Anomaly Detectioncited by 290
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
- 2022TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Datacited by 211
- 2017Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localizationcited by 207
- 2020Can AI help in screening Viral and COVID-19 pneumonia?cited by 200
- 2021The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localizationcited by 174
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
- 2019Segmentation-Based Deep-Learning Approach for Surface-Defect Detectioncited by 145
- 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 138
- 2024AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detectioncited by 126
- 2020GridMask Data Augmentationcited by 123
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2024RealNet: A Feature Selection Network with Realistic Synthetic Anomaly for Anomaly Detectioncited by 116
- 2020Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigmcited by 115
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2024PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detectioncited by 97
- 2023Real3D-AD: A Dataset of Point Cloud Anomaly Detectioncited by 87
- 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
- 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 84
- 2022Local Evaluation of Time Series Anomaly Detection Algorithmscited by 79
- 2021Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspectioncited by 77
- 2023Complementary Pseudo Multimodal Feature for Point Cloud Anomaly Detectioncited by 74
- 2025AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIPcited by 72
- 2022Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptorscited by 66
- 2023Few-Shot Defect Image Generation via Defect-Aware Feature Manipulationcited by 66
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
- 2022The Eyecandies Dataset for Unsupervised Multimodal Anomaly Detection and Localizationcited by 55
- 2022Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented Viewcited by 54
- 2025Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Modelscited by 54
- 2020Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry and Fusioncited by 53
50 most cited of 119 All 119 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Customizing Visual-Language Foundation Models for Multi-modal Anomaly Detection and Reasoning
- 2024MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
- 2025IAD-R1: Reinforcing Consistent Reasoning in Industrial Anomaly Detection
- 2025Detect, Classify, Act: Categorizing Industrial Anomalies with Multi-Modal Large Language Models
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space
- 2025OmniAD: Detect and Understand Industrial Anomaly via Multimodal Reasoning
- 2026M3-AD: Reflection-aware Multi-modal, Multi-category, and Multi-dimensional Benchmark and Framework for Industrial Anomaly Detection
- 2025Can Multimodal Large Language Models be Guided to Improve Industrial Anomaly Detection?