Explainable Deep Few-shot Anomaly Detection with Deviation Networks
Not on the map. Why?
Abstract (arXiv)
Existing anomaly detection paradigms overwhelmingly focus on training detection models using exclusively normal data or unlabeled data (mostly normal samples). One notorious issue with these approaches is that they are weak in discriminating anomalies from normal samples due to the lack of the knowledge about the anomalies. Here, we study the problem of few-shot anomaly detection, in which we aim at using a few labeled anomaly examples to train sample-efficient discriminative detection models. To address this problem, we introduce a novel weakly-supervised anomaly detection framework to train detection models without assuming the examples illustrating all possible classes of anomaly. Specifically, the proposed approach learns discriminative normality (regularity) by leveraging the labeled anomalies and a prior probability to enforce expressive representations of normality and unbounded deviated representations of abnormality. This is achieved by an end-to-end optimization of anomaly scores with a neural deviation learning, in which the anomaly scores of normal samples are imposed to approximate scalar scores drawn from the prior while that of anomaly examples is enforced to have statistically significant deviations from these sampled scores in the upper tail. Furthermore, our model is optimized to learn fine-grained normality and abnormality by top-K multiple-instance-learning-based feature subspace deviation learning, allowing more generalized representations. Comprehensive experiments on nine real-world image anomaly detection benchmarks show that our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings. Our model can also offer explanation capability as a result of its prior-driven anomaly score learning. Code and datasets are available at: https://git.io/DevNet.
Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). Builds on 37 of its 76 references that are in the map. First posted on arXiv 1 Aug 2021.
Builds on
37 of 76 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2019Deep Semi-Supervised Anomaly Detectioncited by 290
- 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
25 more
- 2018Techniques for Interpretable Machine Learningcited by 237
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2018Learning from positive and unlabeled data: a surveycited by 218
- 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
- 2020Classification-Based Anomaly Detection for General Datacited by 210
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2019Deep Anomaly Detection with Deviation Networkscited by 152
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 147
- 2019Segmentation-Based Deep-Learning Approach for Surface-Defect Detectioncited by 145
- 2016Revisiting Multiple Instance Neural Networkscited by 119
- 2018Adversarially Learned Anomaly Detectioncited by 115
- 2020Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigmcited by 115
- 2020Self-trained Deep Ordinal Regression for End-to-End Video Anomaly Detectioncited by 83
- 2018Anomaly Detection using One-Class Neural Networkscited by 82
- 2018Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detectioncited by 79
- 2018Learning Deep Features for One-Class Classificationcited by 76
- 2014Toward Supervised Anomaly Detectioncited by 73
- 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
- 2021A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detectioncited by 60
- 2019Deep Weakly-supervised Anomaly Detectioncited by 59
- 2020Toward Deep Supervised Anomaly Detection: Reinforcement Learning from Partially Labeled Anomaly Datacited by 42
- 2018Automatic Classification of Defective Photovoltaic Module Cells in Electroluminescence Imagescited by 35
- 2019Unsupervised Representation Learning by Predicting Random Distancescited by 34
- 2018One-Class Adversarial Nets for Fraud Detectioncited by 33
Built on by
Citing papers per year: 2022: 15; 2023: 16; 2024: 17; 2025: 13; 2026: 8.
69 papers.
Sort:
By area:
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2023Deep Industrial Image Anomaly Detection: A Surveycited by 147
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2022Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detectioncited by 104
- 2023Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcorecited by 75
- 2022Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detectioncited by 72
- 2023IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturingcited by 64
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2022A Survey on Explainable Anomaly Detectioncited by 39
- 2024Dual-Interrelated Diffusion Model for Few-Shot Anomaly Image Generationcited by 31
- 2024PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detectioncited by 29
38 more
- 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
- 2023Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detectioncited by 25
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
- 2022A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Imagescited by 21
- 2024Supervised Anomaly Detection for Complex Industrial Imagescited by 18
- 2024COFT-AD: COntrastive Fine-Tuning for Few-Shot Anomaly Detectioncited by 13
- 2022Teacher-Student Network for 3D Point Cloud Anomaly Detection with Few Normal Samplescited by 12
- 2024FabGPT: An Efficient Large Multimodal Model for Complex Wafer Defect Knowledge Queriescited by 12
- 2023RoSAS: Deep Semi-Supervised Anomaly Detection with Contamination-Resilient Continuous Supervisioncited by 11
- 2023Few-shot Anomaly Detection in Text with Deviation Learningcited by 11
- 2024SplatPose+: Real-time Image-Based Pose-Agnostic 3D Anomaly Detectioncited by 11
- 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignmentcited by 10
- 2025Distribution Prototype Diffusion Learning for Open-set Supervised Anomaly Detectioncited by 10
- 2024Towards Zero-shot 3D Anomaly Localizationcited by 8
- 2023Unveiling the Unseen: A Comprehensive Survey on Explainable Anomaly Detection in Images and Videoscited by 7
- 2023Anomaly Detection with Score Distribution Discriminationcited by 7
- 2024A Survey of Few-Shot Learning for Biomedical Time Seriescited by 7
- 2024Boosting Fine-Grained Visual Anomaly Detection with Coarse-Knowledge-Aware Adversarial Learningcited by 7
- 2025INP-Former++: Advancing Universal Anomaly Detection via Intrinsic Normal Prototypes and Residual Learningcited by 7
- 2022Creating an Explainable Intrusion Detection System Using Self Organizing Mapscited by 6
- 2023Industrial Anomaly Detection and Localization Using Weakly-Supervised Residual Transformerscited by 6
- 2026MAU-GPT: Enhancing Multi-type Industrial Anomaly Understanding via Anomaly-aware and Generalist Experts Adaptationcited by 6
- 2022Trustworthy Anomaly Detection: A Surveycited by 5
- 2022Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detectioncited by 5
- 2024DMAD: Dual Memory Bank for Real-World Anomaly Detectioncited by 5
- 2024Adaptive Deviation Learning for Visual Anomaly Detection with Data Contaminationcited by 4
- 2025No Label Left Behind: A Unified Surface Defect Detection Model for all Supervision Regimescited by 4
- 2023Explainable Intrusion Detection Systems Using Competitive Learning Techniquescited by 2
- 2023Few-shot Weakly-supervised Cybersecurity Anomaly Detectioncited by 2
- 2023SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detectioncited by 2
- 2025Generate Aligned Anomaly: Region-Guided Few-Shot Anomaly Image-Mask Pair Synthesis for Industrial Inspectioncited by 2
- 2025A Comprehensive Survey for Real-World Industrial Defect Detection: Challenges, Approaches, and Prospectscited by 2
- 2025MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detectioncited by 2
- 2022LesionPaste: One-Shot Anomaly Detection for Medical Imagescited by 1
- 2023Robust Fraud Detection via Supervised Contrastive Learningcited by 1
- 2024Qsco: A Quantum Scoring Module for Open-set Supervised Anomaly Detectioncited by 1
- 2024Interactive Explainable Anomaly Detection for Industrial Settingscited by 1
- 2025Swift Hydra: Self-Reinforcing Generative Framework for Anomaly Detection with Multiple Mamba Modelscited by 1
50 most cited of 69 All 69 (JSON)
- 2026ArcAD: Anomaly-Rectified Calibration for Cold-Start Supervised Anomaly Detection2 Jul 2026
- 2026Anomaly-Preference Image Generation4 May 2026
- 2026Mixture Prototype Flow Matching for Open-Set Supervised Anomaly Detection4 May 2026
- 2026FB-CLIP: Fine-Grained Zero-Shot Anomaly Detection with Foreground-Background Disentanglement20 Mar 2026
- 2026Referring Industrial Anomaly Segmentation3 Feb 2026
- 2026MAU-GPT: Enhancing Multi-type Industrial Anomaly Understanding via Anomaly-aware and Generalist Experts Adaptation31 Jan 2026
- 2026Multi-Cue Anomaly Detection and Localization under Data Contamination30 Jan 2026
- 2026DevPrompt: Deviation-Based Prompt Learning for One-Normal ShotImage Anomaly Detection21 Jan 2026
- 2025CEDL: Centre-Enhanced Discriminative Learning for Anomaly Detection15 Nov 2025
- 2025Double Helix Diffusion for Cross-Domain Anomaly Image Generation16 Sep 2025
- 2025MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detection12 Sep 2025
- 2025Towards Efficient Pixel Labeling for Industrial Anomaly Detection and Localization5 Sep 2025
38 more
- 2025PointAD+: Learning Hierarchical Representations for Zero-shot 3D Anomaly Detection3 Sep 2025
- 2025No Label Left Behind: A Unified Surface Defect Detection Model for all Supervision Regimes26 Aug 2025
- 2025A Comprehensive Survey for Real-World Industrial Defect Detection: Challenges, Approaches, and Prospects15 Jul 2025
- 2025Crucial-Diff: A Unified Diffusion Model for Crucial Image and Annotation Synthesis in Data-scarce Scenarios14 Jul 2025
- 2025Generate Aligned Anomaly: Region-Guided Few-Shot Anomaly Image-Mask Pair Synthesis for Industrial Inspection13 Jul 2025
- 2025INP-Former++: Advancing Universal Anomaly Detection via Intrinsic Normal Prototypes and Residual Learning4 Jun 2025
- 2025Beyond Academic Benchmarks: Critical Analysis and Best Practices for Visual Industrial Anomaly Detection30 Mar 2025
- 2025Swift Hydra: Self-Reinforcing Generative Framework for Anomaly Detection with Multiple Mamba Models9 Mar 2025
- 2025Distribution Prototype Diffusion Learning for Open-set Supervised Anomaly Detection28 Feb 2025
- 2024Boosting Fine-Grained Visual Anomaly Detection with Coarse-Knowledge-Aware Adversarial Learning17 Dec 2024
- 2024Towards Zero-shot 3D Anomaly Localization5 Dec 2024
- 2024Adaptive Deviation Learning for Visual Anomaly Detection with Data Contamination14 Nov 2024
- 2024SplatPose+: Real-time Image-Based Pose-Agnostic 3D Anomaly Detection15 Oct 2024
- 2024Interactive Explainable Anomaly Detection for Industrial Settings1 Oct 2024
- 2024PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detection1 Oct 2024
- 2024MeLIAD: Interpretable Few-Shot Anomaly Detection with Metric Learning and Entropy-based Scoring20 Sep 2024
- 2024Dual-Interrelated Diffusion Model for Few-Shot Anomaly Image Generation24 Aug 2024
- 2024FabGPT: An Efficient Large Multimodal Model for Complex Wafer Defect Knowledge Queries15 Jul 2024
- 2024Towards Efficient Pixel Labeling for Industrial Anomaly Detection and Localization3 Jul 2024
- 2024ATAC-Net: Zoomed view works better for Anomaly Detection20 Jun 2024
- 2024Qsco: A Quantum Scoring Module for Open-set Supervised Anomaly Detection25 May 2024
- 2024Supervised Anomaly Detection for Complex Industrial Images8 May 2024
- 2024A Survey of Few-Shot Learning for Biomedical Time Series3 May 2024
- 2024DMAD: Dual Memory Bank for Real-World Anomaly Detection19 Mar 2024
- 2024COFT-AD: COntrastive Fine-Tuning for Few-Shot Anomaly Detection29 Feb 2024
- 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignment6 Feb 2024
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model10 Dec 2023
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection29 Oct 2023
- 2023Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detection19 Oct 2023
- 2023Few-shot Anomaly Detection in Text with Deviation Learning22 Aug 2023
- 2023Robust Fraud Detection via Supervised Contrastive Learning19 Aug 2023
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrieval13 Aug 2023
- 2023RoSAS: Deep Semi-Supervised Anomaly Detection with Contamination-Resilient Continuous Supervision25 Jul 2023
- 2023Anomaly Detection with Score Distribution Discrimination26 Jun 2023
- 2023SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detection14 Jun 2023
- 2023Industrial Anomaly Detection and Localization Using Weakly-Supervised Residual Transformers6 Jun 2023
- 2023Few-shot Weakly-supervised Cybersecurity Anomaly Detection15 Apr 2023
- 2023Explainable Intrusion Detection Systems Using Competitive Learning Techniques30 Mar 2023
50 newest of 69 All 69 (JSON)
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2024Dual-Interrelated Diffusion Model for Few-Shot Anomaly Image Generationcited by 31
- 2025Crucial-Diff: A Unified Diffusion Model for Crucial Image and Annotation Synthesis in Data-scarce Scenarioscited by 0
- 2026Mixture Prototype Flow Matching for Open-Set Supervised Anomaly Detectioncited by 0
- 2026Mixture Prototype Flow Matching for Open-Set Supervised Anomaly Detection4 May 2026
- 2025Crucial-Diff: A Unified Diffusion Model for Crucial Image and Annotation Synthesis in Data-scarce Scenarios14 Jul 2025
- 2024Dual-Interrelated Diffusion Model for Few-Shot Anomaly Image Generation24 Aug 2024
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model10 Dec 2023
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2023Deep Industrial Image Anomaly Detection: A Surveycited by 147
- 2022Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detectioncited by 104
- 2023Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcorecited by 75
- 2022Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detectioncited by 72
- 2023IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturingcited by 64
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2022A Survey on Explainable Anomaly Detectioncited by 39
- 2024PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detectioncited by 29
- 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
- 2023Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detectioncited by 25
12 most cited of 63 All 63 (JSON)
- 2026ArcAD: Anomaly-Rectified Calibration for Cold-Start Supervised Anomaly Detection2 Jul 2026
- 2026Anomaly-Preference Image Generation4 May 2026
- 2026FB-CLIP: Fine-Grained Zero-Shot Anomaly Detection with Foreground-Background Disentanglement20 Mar 2026
- 2026Referring Industrial Anomaly Segmentation3 Feb 2026
- 2026MAU-GPT: Enhancing Multi-type Industrial Anomaly Understanding via Anomaly-aware and Generalist Experts Adaptation31 Jan 2026
- 2026Multi-Cue Anomaly Detection and Localization under Data Contamination30 Jan 2026
- 2025CEDL: Centre-Enhanced Discriminative Learning for Anomaly Detection15 Nov 2025
- 2025Double Helix Diffusion for Cross-Domain Anomaly Image Generation16 Sep 2025
- 2025MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detection12 Sep 2025
- 2025Towards Efficient Pixel Labeling for Industrial Anomaly Detection and Localization5 Sep 2025
- 2025PointAD+: Learning Hierarchical Representations for Zero-shot 3D Anomaly Detection3 Sep 2025
- 2025No Label Left Behind: A Unified Surface Defect Detection Model for all Supervision Regimes26 Aug 2025
12 newest of 63 All 63 (JSON)