mlsanityData to 7 Oct 2026

Zero-Shot Anomaly Detection via Batch Normalization

arXiv 2302.07849 ↗First posted 15 Feb 2023cs.LG cs.AI stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Anomaly detection (AD) plays a crucial role in many safety-critical application domains. The challenge of adapting an anomaly detector to drift in the normal data distribution, especially when no training data is available for the "new normal," has led to the development of zero-shot AD techniques. In this paper, we propose a simple yet effective method called Adaptive Centered Representations (ACR) for zero-shot batch-level AD. Our approach trains off-the-shelf deep anomaly detectors (such as deep SVDD) to adapt to a set of inter-related training data distributions in combination with batch normalization, enabling automatic zero-shot generalization for unseen AD tasks. This simple recipe, batch normalization plus meta-training, is a highly effective and versatile tool. Our theoretical results guarantee the zero-shot generalization for unseen AD tasks; our empirical results demonstrate the first zero-shot AD results for tabular data and outperform existing methods in zero-shot anomaly detection and segmentation on image data from specialized domains. Code is at https://github.com/aodongli/zero-shot-ad-via-batch-norm

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 57 of its 85 references that are in the map. First posted on arXiv 15 Feb 2023.

Builds on

57 of 85 references.

References · 57

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2016Densely Connected Convolutional Networkscited by 6,691
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  7. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  8. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  9. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  10. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  11. 2020Designing Network Design Spacescited by 954
  12. 2018Deep Anomaly Detection with Outlier Exposurecited by 939
38 more
  1. 2021Florence: A New Foundation Model for Computer Visioncited by 802
  2. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  3. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
  4. 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
  5. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
  6. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  7. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
  8. 2020Improving robustness against common corruptions by covariate shift adaptationcited by 427
  9. 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
  10. 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 316
  11. 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 297
  12. 2019Deep Semi-Supervised Anomaly Detectioncited by 290
  13. 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
  14. 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 235
  15. 2022ADBench: Anomaly Detection Benchmarkcited by 230
  16. 2020Classification-Based Anomaly Detection for General Datacited by 210
  17. 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
  18. 2019A review of domain adaptation without target labelscited by 154
  19. 2022ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functionscited by 153
  20. 2021Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIPcited by 151
  21. 2020COPOD: Copula-Based Outlier Detectioncited by 143
  22. 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
  23. 2022Registration based Few-Shot Anomaly Detectioncited by 133
  24. 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
  25. 2023TTN: A Domain-Shift Aware Batch Normalization in Test-Time Adaptationcited by 101
  26. 2021Neural Transformation Learning for Deep Anomaly Detection Beyond Imagescited by 98
  27. 2018Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoderscited by 83
  28. 2022Improving Test-Time Adaptation via Shift-agnostic Weight Regularization and Nearest Source Prototypescited by 67
  29. 2021Few-shot Network Anomaly Detection via Cross-network Meta-learningcited by 64
  30. 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
  31. 2021A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detectioncited by 60
  32. 2022Latent Outlier Exposure for Anomaly Detection with Contaminated Datacited by 48
  33. 2022Raising the Bar in Graph-level Anomaly Detectioncited by 45
  34. 2021LUNAR: Unifying Local Outlier Detection Methods via Graph Neural Networkscited by 42
  35. 2021Generalization of Model-Agnostic Meta-Learning Algorithms: Recurring and Unseen Taskscited by 36
  36. 2022Exposing Outlier Exposure: What Can Be Learned From Few, One, and Zero Outlier Imagescited by 35
  37. 2022MAEDAY: MAE for few and zero shot AnomalY-Detectioncited by 30
  38. 2020Detecting and Adapting to Irregular Distribution Shifts in Bayesian Online Learningcited by 18

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.