Zero-Shot Anomaly Detection via Batch Normalization
Not on the map. Why?
Abstract (arXiv)
Anomaly detection (AD) plays a crucial role in many safety-critical application domains. The challenge of adapting an anomaly detector to drift in the normal data distribution, especially when no training data is available for the "new normal," has led to the development of zero-shot AD techniques. In this paper, we propose a simple yet effective method called Adaptive Centered Representations (ACR) for zero-shot batch-level AD. Our approach trains off-the-shelf deep anomaly detectors (such as deep SVDD) to adapt to a set of inter-related training data distributions in combination with batch normalization, enabling automatic zero-shot generalization for unseen AD tasks. This simple recipe, batch normalization plus meta-training, is a highly effective and versatile tool. Our theoretical results guarantee the zero-shot generalization for unseen AD tasks; our empirical results demonstrate the first zero-shot AD results for tabular data and outperform existing methods in zero-shot anomaly detection and segmentation on image data from specialized domains. Code is at https://github.com/aodongli/zero-shot-ad-via-batch-norm
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 57 of its 85 references that are in the map. First posted on arXiv 15 Feb 2023.
Builds on
57 of 85 references.
References · 57
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2020Designing Network Design Spacescited by 954
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
38 more
- 2021Florence: A New Foundation Model for Computer Visioncited by 802
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2020Improving robustness against common corruptions by covariate shift adaptationcited by 427
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
- 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 316
- 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 297
- 2019Deep Semi-Supervised Anomaly Detectioncited by 290
- 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
- 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 235
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2020Classification-Based Anomaly Detection for General Datacited by 210
- 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
- 2019A review of domain adaptation without target labelscited by 154
- 2022ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functionscited by 153
- 2021Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIPcited by 151
- 2020COPOD: Copula-Based Outlier Detectioncited by 143
- 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
- 2023TTN: A Domain-Shift Aware Batch Normalization in Test-Time Adaptationcited by 101
- 2021Neural Transformation Learning for Deep Anomaly Detection Beyond Imagescited by 98
- 2018Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoderscited by 83
- 2022Improving Test-Time Adaptation via Shift-agnostic Weight Regularization and Nearest Source Prototypescited by 67
- 2021Few-shot Network Anomaly Detection via Cross-network Meta-learningcited by 64
- 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
- 2021A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detectioncited by 60
- 2022Latent Outlier Exposure for Anomaly Detection with Contaminated Datacited by 48
- 2022Raising the Bar in Graph-level Anomaly Detectioncited by 45
- 2021LUNAR: Unifying Local Outlier Detection Methods via Graph Neural Networkscited by 42
- 2021Generalization of Model-Agnostic Meta-Learning Algorithms: Recurring and Unseen Taskscited by 36
- 2022Exposing Outlier Exposure: What Can Be Learned From Few, One, and Zero Outlier Imagescited by 35
- 2022MAEDAY: MAE for few and zero shot AnomalY-Detectioncited by 30
- 2020Detecting and Adapting to Irregular Distribution Shifts in Bayesian Online Learningcited by 18
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.