mlsanityData to 7 Oct 2026

Explainable Deep Few-shot Anomaly Detection with Deviation Networks

arXiv 2108.00462 ↗First posted 1 Aug 2021cs.CV cs.AI cs.LGcited by 69

Not on the map. Why?

Abstract (arXiv)

Existing anomaly detection paradigms overwhelmingly focus on training detection models using exclusively normal data or unlabeled data (mostly normal samples). One notorious issue with these approaches is that they are weak in discriminating anomalies from normal samples due to the lack of the knowledge about the anomalies. Here, we study the problem of few-shot anomaly detection, in which we aim at using a few labeled anomaly examples to train sample-efficient discriminative detection models. To address this problem, we introduce a novel weakly-supervised anomaly detection framework to train detection models without assuming the examples illustrating all possible classes of anomaly. Specifically, the proposed approach learns discriminative normality (regularity) by leveraging the labeled anomalies and a prior probability to enforce expressive representations of normality and unbounded deviated representations of abnormality. This is achieved by an end-to-end optimization of anomaly scores with a neural deviation learning, in which the anomaly scores of normal samples are imposed to approximate scalar scores drawn from the prior while that of anomaly examples is enforced to have statistically significant deviations from these sampled scores in the upper tail. Furthermore, our model is optimized to learn fine-grained normality and abnormality by top-K multiple-instance-learning-based feature subspace deviation learning, allowing more generalized representations. Comprehensive experiments on nine real-world image anomaly detection benchmarks show that our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings. Our model can also offer explanation capability as a result of its prior-driven anomaly score learning. Code and datasets are available at: https://git.io/DevNet.

Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). Builds on 37 of its 76 references that are in the map. First posted on arXiv 1 Aug 2021.

Builds on

37 of 76 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
  5. 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
  6. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
  7. 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
  8. 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
  9. 2019Deep Semi-Supervised Anomaly Detectioncited by 290
  10. 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
  11. 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
  12. 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
25 more
  1. 2018Techniques for Interpretable Machine Learningcited by 237
  2. 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
  3. 2018Learning from positive and unlabeled data: a surveycited by 218
  4. 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
  5. 2020Classification-Based Anomaly Detection for General Datacited by 210
  6. 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
  7. 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
  8. 2019Deep Anomaly Detection with Deviation Networkscited by 152
  9. 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 147
  10. 2019Segmentation-Based Deep-Learning Approach for Surface-Defect Detectioncited by 145
  11. 2016Revisiting Multiple Instance Neural Networkscited by 119
  12. 2018Adversarially Learned Anomaly Detectioncited by 115
  13. 2020Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigmcited by 115
  14. 2020Self-trained Deep Ordinal Regression for End-to-End Video Anomaly Detectioncited by 83
  15. 2018Anomaly Detection using One-Class Neural Networkscited by 82
  16. 2018Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detectioncited by 79
  17. 2018Learning Deep Features for One-Class Classificationcited by 76
  18. 2014Toward Supervised Anomaly Detectioncited by 73
  19. 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
  20. 2021A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detectioncited by 60
  21. 2019Deep Weakly-supervised Anomaly Detectioncited by 59
  22. 2020Toward Deep Supervised Anomaly Detection: Reinforcement Learning from Partially Labeled Anomaly Datacited by 42
  23. 2018Automatic Classification of Defective Photovoltaic Module Cells in Electroluminescence Imagescited by 35
  24. 2019Unsupervised Representation Learning by Predicting Random Distancescited by 34
  25. 2018One-Class Adversarial Nets for Fraud Detectioncited by 33

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 15; 2023: 16; 2024: 17; 2025: 13; 2026: 8.

69 papers.

Sort:

By area:

  1. 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
  2. 2022ADBench: Anomaly Detection Benchmarkcited by 230
  3. 2023Deep Industrial Image Anomaly Detection: A Surveycited by 147
  4. 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
  5. 2022Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detectioncited by 104
  6. 2023Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcorecited by 75
  7. 2022Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detectioncited by 72
  8. 2023IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturingcited by 64
  9. 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
  10. 2022A Survey on Explainable Anomaly Detectioncited by 39
  11. 2024Dual-Interrelated Diffusion Model for Few-Shot Anomaly Image Generationcited by 31
  12. 2024PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detectioncited by 29
38 more
  1. 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
  2. 2023Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detectioncited by 25
  3. 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
  4. 2022A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Imagescited by 21
  5. 2024Supervised Anomaly Detection for Complex Industrial Imagescited by 18
  6. 2024COFT-AD: COntrastive Fine-Tuning for Few-Shot Anomaly Detectioncited by 13
  7. 2022Teacher-Student Network for 3D Point Cloud Anomaly Detection with Few Normal Samplescited by 12
  8. 2024FabGPT: An Efficient Large Multimodal Model for Complex Wafer Defect Knowledge Queriescited by 12
  9. 2023RoSAS: Deep Semi-Supervised Anomaly Detection with Contamination-Resilient Continuous Supervisioncited by 11
  10. 2023Few-shot Anomaly Detection in Text with Deviation Learningcited by 11
  11. 2024SplatPose+: Real-time Image-Based Pose-Agnostic 3D Anomaly Detectioncited by 11
  12. 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignmentcited by 10
  13. 2025Distribution Prototype Diffusion Learning for Open-set Supervised Anomaly Detectioncited by 10
  14. 2024Towards Zero-shot 3D Anomaly Localizationcited by 8
  15. 2023Unveiling the Unseen: A Comprehensive Survey on Explainable Anomaly Detection in Images and Videoscited by 7
  16. 2023Anomaly Detection with Score Distribution Discriminationcited by 7
  17. 2024A Survey of Few-Shot Learning for Biomedical Time Seriescited by 7
  18. 2024Boosting Fine-Grained Visual Anomaly Detection with Coarse-Knowledge-Aware Adversarial Learningcited by 7
  19. 2025INP-Former++: Advancing Universal Anomaly Detection via Intrinsic Normal Prototypes and Residual Learningcited by 7
  20. 2022Creating an Explainable Intrusion Detection System Using Self Organizing Mapscited by 6
  21. 2023Industrial Anomaly Detection and Localization Using Weakly-Supervised Residual Transformerscited by 6
  22. 2026MAU-GPT: Enhancing Multi-type Industrial Anomaly Understanding via Anomaly-aware and Generalist Experts Adaptationcited by 6
  23. 2022Trustworthy Anomaly Detection: A Surveycited by 5
  24. 2022Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detectioncited by 5
  25. 2024DMAD: Dual Memory Bank for Real-World Anomaly Detectioncited by 5
  26. 2024Adaptive Deviation Learning for Visual Anomaly Detection with Data Contaminationcited by 4
  27. 2025No Label Left Behind: A Unified Surface Defect Detection Model for all Supervision Regimescited by 4
  28. 2023Explainable Intrusion Detection Systems Using Competitive Learning Techniquescited by 2
  29. 2023Few-shot Weakly-supervised Cybersecurity Anomaly Detectioncited by 2
  30. 2023SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detectioncited by 2
  31. 2025Generate Aligned Anomaly: Region-Guided Few-Shot Anomaly Image-Mask Pair Synthesis for Industrial Inspectioncited by 2
  32. 2025A Comprehensive Survey for Real-World Industrial Defect Detection: Challenges, Approaches, and Prospectscited by 2
  33. 2025MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detectioncited by 2
  34. 2022LesionPaste: One-Shot Anomaly Detection for Medical Imagescited by 1
  35. 2023Robust Fraud Detection via Supervised Contrastive Learningcited by 1
  36. 2024Qsco: A Quantum Scoring Module for Open-set Supervised Anomaly Detectioncited by 1
  37. 2024Interactive Explainable Anomaly Detection for Industrial Settingscited by 1
  38. 2025Swift Hydra: Self-Reinforcing Generative Framework for Anomaly Detection with Multiple Mamba Modelscited by 1

50 most cited of 69 All 69 (JSON)