Quantile-based Maximum Likelihood Training for Outlier Detection
Not on the map. Why?
Abstract (arXiv)
Discriminative learning effectively predicts true object class for image classification. However, it often results in false positives for outliers, posing critical concerns in applications like autonomous driving and video surveillance systems. Previous attempts to address this challenge involved training image classifiers through contrastive learning using actual outlier data or synthesizing outliers for self-supervised learning. Furthermore, unsupervised generative modeling of inliers in pixel space has shown limited success for outlier detection. In this work, we introduce a quantile-based maximum likelihood objective for learning the inlier distribution to improve the outlier separation during inference. Our approach fits a normalizing flow to pre-trained discriminative features and detects the outliers according to the evaluated log-likelihood. The experimental evaluation demonstrates the effectiveness of our method as it surpasses the performance of the state-of-the-art unsupervised methods for outlier detection. The results are also competitive compared with a recent self-supervised approach for outlier detection. Our work allows to reduce dependency on well-sampled negative training data, which is especially important for domains like medical diagnostics or remote sensing.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 20 Aug 2023.
Builds on
56 of 68 references.
References · 56
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2016Wide Residual Networkscited by 3,070
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2013Describing Textures in the Wildcited by 2,125
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
38 more
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 594
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2017Distributional Reinforcement Learning with Quantile Regressioncited by 474
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 421
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
- 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 321
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 221
- 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
- 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
- 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
- 2022CFA: Coupled-hypersphere-based Feature Adaptation for Target-Oriented Anomaly Localizationcited by 135
- 2023Non-Parametric Outlier Synthesiscited by 129
- 2019The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentationcited by 122
- 2021Fully Convolutional Cross-Scale-Flows for Image-based Defect Detectioncited by 117
- 2022Asymmetric Student-Teacher Networks for Industrial Anomaly Detectioncited by 117
- 2020ATOM: Robustifying Out-of-distribution Detection Using Outlier Miningcited by 116
- 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
- 2020Hybrid Models for Open Set Recognitioncited by 109
- 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
- 2022Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detectioncited by 104
- 2021Can multi-label classification networks know what they don't know?cited by 100
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2020Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)cited by 92
- 2022Training OOD Detectors in their Natural Habitatscited by 86
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2024: 3.
3 papers.