mlsanityData to 14 Oct 2026

Quantile-based Maximum Likelihood Training for Outlier Detection

arXiv 2310.06085 ↗First posted 20 Aug 2023cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Discriminative learning effectively predicts true object class for image classification. However, it often results in false positives for outliers, posing critical concerns in applications like autonomous driving and video surveillance systems. Previous attempts to address this challenge involved training image classifiers through contrastive learning using actual outlier data or synthesizing outliers for self-supervised learning. Furthermore, unsupervised generative modeling of inliers in pixel space has shown limited success for outlier detection. In this work, we introduce a quantile-based maximum likelihood objective for learning the inlier distribution to improve the outlier separation during inference. Our approach fits a normalizing flow to pre-trained discriminative features and detects the outliers according to the evaluated log-likelihood. The experimental evaluation demonstrates the effectiveness of our method as it surpasses the performance of the state-of-the-art unsupervised methods for outlier detection. The results are also competitive compared with a recent self-supervised approach for outlier detection. Our work allows to reduce dependency on well-sampled negative training data, which is especially important for domains like medical diagnostics or remote sensing.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 20 Aug 2023.

Builds on

56 of 68 references.

References · 56

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  4. 2016Wide Residual Networkscited by 3,070
  5. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  7. 2013Describing Textures in the Wildcited by 2,125
  8. 2016Density estimation using Real NVPcited by 2,042
  9. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  10. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  11. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  12. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
38 more
  1. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  2. 2014NICE: Non-linear Independent Components Estimationcited by 1,058
  3. 2018Deep Anomaly Detection with Outlier Exposurecited by 942
  4. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
  5. 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
  6. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  7. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 594
  8. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
  9. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
  10. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  11. 2017Distributional Reinforcement Learning with Quantile Regressioncited by 474
  12. 2018Do Deep Generative Models Know What They Don't Know?cited by 443
  13. 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
  14. 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 421
  15. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  16. 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
  17. 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
  18. 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
  19. 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 321
  20. 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
  21. 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 221
  22. 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
  23. 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
  24. 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
  25. 2022CFA: Coupled-hypersphere-based Feature Adaptation for Target-Oriented Anomaly Localizationcited by 135
  26. 2023Non-Parametric Outlier Synthesiscited by 129
  27. 2019The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentationcited by 122
  28. 2021Fully Convolutional Cross-Scale-Flows for Image-based Defect Detectioncited by 117
  29. 2022Asymmetric Student-Teacher Networks for Industrial Anomaly Detectioncited by 117
  30. 2020ATOM: Robustifying Out-of-distribution Detection Using Outlier Miningcited by 116
  31. 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
  32. 2020Hybrid Models for Open Set Recognitioncited by 109
  33. 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
  34. 2022Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detectioncited by 104
  35. 2021Can multi-label classification networks know what they don't know?cited by 100
  36. 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
  37. 2020Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)cited by 92
  38. 2022Training OOD Detectors in their Natural Habitatscited by 86

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.