Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoder
Not on the map. Why?
Abstract (arXiv)
Deep probabilistic generative models enable modeling the likelihoods of very high dimensional data. An important application of generative modeling should be the ability to detect out-of-distribution (OOD) samples by setting a threshold on the likelihood. However, some recent studies show that probabilistic generative models can, in some cases, assign higher likelihoods on certain types of OOD samples, making the OOD detection rules based on likelihood threshold problematic. To address this issue, several OOD detection methods have been proposed for deep generative models. In this paper, we make the observation that many of these methods fail when applied to generative models based on Variational Auto-encoders (VAE). As an alternative, we propose Likelihood Regret, an efficient OOD score for VAEs. We benchmark our proposed method over existing approaches, and empirical results suggest that our method obtains the best overall OOD detection performances when applied to VAEs.
Key facts. Cited by 145 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 34; 2023: 31; 2024: 31; 2025: 19; 2026: 11.
145 papers.
Sort:
By area:
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 338
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 215
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2022How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?cited by 128
- 2022Is Out-of-Distribution Detection Learnable?cited by 109
- 2022Denoising diffusion models for out-of-distribution detectioncited by 102
- 2021Can multi-label classification networks know what they don't know?cited by 100
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2021On the Impact of Spurious Correlation for Out-of-distribution Detectioncited by 68
- 2021Hierarchical VAEs Know What They Don't Knowcited by 58
38 more
- 2023Unsupervised Out-of-Distribution Detection with Diffusion Inpaintingcited by 57
- 2023Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEscited by 54
- 2022RankFeat: Rank-1 Feature Removal for Out-of-distribution Detectioncited by 52
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2022Boosting Out-of-distribution Detection with Typical Featurescited by 48
- 2024A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP)cited by 44
- 2024Learning with Mixture of Prototypes for Out-of-Distribution Detectioncited by 43
- 2024Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modellingcited by 43
- 2023Model-Based Runtime Monitoring with Interactive Imitation Learningcited by 37
- 2024Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detectioncited by 30
- 2022Watermarking for Out-of-distribution Detectioncited by 28
- 2021Autoencoding Under Normalization Constraintscited by 26
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
- 2022Breaking Down Out-of-Distribution Detection: Many Methods Based on OOD Training Data Estimate a Combination of the Same Core Quantitiescited by 23
- 2022Out-of-distribution Detection via Frequency-regularized Generative Modelscited by 23
- 2024A Geometric Explanation of the Likelihood OOD Detection Paradoxcited by 22
- 2022Igeood: An Information Geometry Approach to Out-of-Distribution Detectioncited by 20
- 2022Adaptive Multi-stage Density Ratio Estimation for Learning Latent Space Energy-based Modelcited by 18
- 2021Do We Really Need to Learn Representations from In-domain Data for Outlier Detection?cited by 16
- 2021Entropic Issues in Likelihood-Based OOD Detectioncited by 16
- 2024Learning Structured Representations with Hyperbolic Embeddingscited by 16
- 2025GOLD: Graph Out-of-Distribution Detection via Implicit Adversarial Latent Generationcited by 15
- 2022Model-agnostic out-of-distribution detection using combined statistical testscited by 14
- 2022Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projectioncited by 13
- 2024Conjugated Semantic Pool Improves OOD Detection with Pre-trained Vision-Language Modelscited by 13
- 2023Fine-Tuning Deteriorates General Textual Out-of-Distribution Detection by Distorting Task-Agnostic Featurescited by 12
- 20223DOS: Towards 3D Open Set Learning -- Benchmarking and Understanding Semantic Novelty Detection on Point Cloudscited by 11
- 2022Out-of-Distribution Detection with Reconstruction Error and Typicality-based Penaltycited by 11
- 2024Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adaptcited by 11
- 2026Foundational World Models Accurately Detect Bimanual Manipulator Failurescited by 11
- 2023Likelihood-based Out-of-Distribution Detection with Denoising Diffusion Probabilistic Modelscited by 10
- 2023SMARLA: A Safety Monitoring Approach for Deep Reinforcement Learning Agentscited by 9
- 2023Model-free Test Time Adaptation for Out-Of-Distribution Detectioncited by 9
- 2023Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Modelscited by 9
- 2021Robust outlier detection by de-biasing VAE likelihoodscited by 8
- 2022Rethinking Out-of-Distribution Detection From a Human-Centric Perspectivecited by 7
- 2023Unveiling the Unseen: A Comprehensive Survey on Explainable Anomaly Detection in Images and Videoscited by 7
- 2024Taming False Positives in Out-of-Distribution Detection with Human Feedbackcited by 7
50 most cited of 145 All 145 (JSON)
- 2026A Probabilistic Circuit-Induced Pseudo-Metric for Out-of-Distribution Detection10 Aug 2026
- 2026Dual Feature Decoupling for Fine-Grained OOD Detection4 Jun 2026
- 2026Local Diagnostics of Continuous Normalizing Flow for Out-of-Distribution Detection30 May 2026
- 2026The Signal in the Noise: OOD Detection Through Goodness-of-Fit Testing in Factorised Latent Spaces21 May 2026
- 2026Early High-Frequency Injection for Geometry-Sensitive OOD Detection20 May 2026
- 2026Tippett-minimum Fusion of Representation-space Diffusion Models for Multi-Encoder Out-of-Distribution Detection19 May 2026
- 2026Geometry over Density: Few-Shot Cross-Domain OOD Detection5 May 2026
- 2026Foundational World Models Accurately Detect Bimanual Manipulator Failures7 Mar 2026
- 2026Mind the Way You Select Negative Texts: Pursuing the Distance Consistency in OOD Detection with VLMs3 Mar 2026
- 2026DAVIS: OOD Detection via Dominant Activations and Variance for Increased Separation30 Jan 2026
- 2026Vision Also You Need: Navigating Out-of-Distribution Detection with Multimodal Large Language Model20 Jan 2026
- 2025FedSDWC: Federated Synergistic Dual-Representation Weak Causal Learning for OOD12 Nov 2025
38 more
- 2025EigenScore: OOD Detection using Covariance in Diffusion Models8 Oct 2025
- 2025Out of Distribution Detection for Efficient Continual Learning in Quality Prediction for Arc Welding22 Aug 2025
- 2025Pathology-Informed Latent Diffusion Model for Anomaly Detection in Lymph Node Metastasis21 Aug 2025
- 2025Generative Adversarial Evasion and Out-of-Distribution Detection for UAV Cyber-Attacks26 Jun 2025
- 2025Enclosing Prototypical Variational Autoencoder for Explainable Out-of-Distribution Detection17 Jun 2025
- 2025Cybersecurity threat detection based on a UEBA framework using Deep Autoencoders14 May 2025
- 2025Recent Advances in Out-of-Distribution Detection with CLIP-Like Models: A Survey5 May 2025
- 2025Can We Ignore Labels In Out of Distribution Detection?20 Apr 2025
- 2025MetaSel: A Test Selection Approach for Fine-tuned DNN Models21 Mar 2025
- 2025OT-DETECTOR: Delving into Optimal Transport for Zero-shot Out-of-Distribution Detection9 Mar 2025
- 2025Guaranteeing Out-Of-Distribution Detection in Deep RL via Transition Estimation7 Mar 2025
- 2025Multi-label out-of-distribution detection via evidential learning25 Feb 2025
- 2025DOSE3 : Diffusion-based Out-of-distribution detection on SE(3) trajectories23 Feb 2025
- 2025Beyond Confidence: Adaptive Abstention in Dual-Threshold Conformal Prediction for Autonomous System Perception11 Feb 2025
- 2025GOLD: Graph Out-of-Distribution Detection via Implicit Adversarial Latent Generation9 Feb 2025
- 2025Intelligent Sensing-to-Action for Robust Autonomy at the Edge: Opportunities and Challenges4 Feb 2025
- 2025Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving14 Jan 2025
- 2025DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection14 Jan 2025
- 2024Learning Structured Representations with Hyperbolic Embeddings2 Dec 2024
- 2024Diffusion-based Layer-wise Semantic Reconstruction for Unsupervised Out-of-Distribution Detection16 Nov 2024
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectors6 Nov 2024
- 2024Conjugated Semantic Pool Improves OOD Detection with Pre-trained Vision-Language Models11 Oct 2024
- 2024Collaborative Knowledge Distillation via a Learning-by-Education Node Community30 Sep 2024
- 2024Unsupervised Hybrid framework for ANomaly Detection (HAND) -- applied to Screening Mammogram17 Sep 2024
- 2024Resultant: Incremental Effectiveness on Likelihood for Unsupervised Out-of-Distribution Detection5 Sep 2024
- 2024Hierarchical Visual Categories Modeling: A Joint Representation Learning and Density Estimation Framework for Out-of-Distribution Detection28 Aug 2024
- 2024Low-Quality Image Detection by Hierarchical VAE20 Aug 2024
- 2024Your Classifier Can Be Secretly a Likelihood-Based OOD Detector9 Aug 2024
- 2024Gradient-based inference of abstract task representations for generalization in neural networks24 Jul 2024
- 2024Learning Non-Linear Invariants for Unsupervised Out-of-Distribution Detection4 Jul 2024
- 2024Combine and Conquer: A Meta-Analysis on Data Shift and Out-of-Distribution Detection23 Jun 2024
- 2024Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detection2 Jun 2024
- 2024Out-of-distribution Reject Option Method for Dataset Shift Problem in Early Disease Onset Prediction30 May 2024
- 2024Deep Positive-Unlabeled Anomaly Detection for Contaminated Unlabeled Data29 May 2024
- 2024Taming False Positives in Out-of-Distribution Detection with Human Feedback25 Apr 2024
- 2024Differentiable Score-Based Likelihoods: Learning CT Motion Compensation From Clean Images23 Apr 2024
- 2024Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling19 Apr 2024
- 2024VI-OOD: A Unified Representation Learning Framework for Textual Out-of-distribution Detection9 Apr 2024
50 newest of 145 All 145 (JSON)
- 2022Denoising diffusion models for out-of-distribution detectioncited by 102
- 2023Unsupervised Out-of-Distribution Detection with Diffusion Inpaintingcited by 57
- 2023Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEscited by 54
- 2024Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modellingcited by 43
- 2023Likelihood-based Out-of-Distribution Detection with Denoising Diffusion Probabilistic Modelscited by 10
- 2023Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Modelscited by 9
- 2024Diffusion-based Layer-wise Semantic Reconstruction for Unsupervised Out-of-Distribution Detectioncited by 5
- 2025EigenScore: OOD Detection using Covariance in Diffusion Modelscited by 4
- 2024Approximations to the Fisher Information Metric of Deep Generative Models for Out-Of-Distribution Detectioncited by 2
- 2025Pathology-Informed Latent Diffusion Model for Anomaly Detection in Lymph Node Metastasiscited by 1
- 2026Tippett-minimum Fusion of Representation-space Diffusion Models for Multi-Encoder Out-of-Distribution Detectioncited by 0
- 2026Tippett-minimum Fusion of Representation-space Diffusion Models for Multi-Encoder Out-of-Distribution Detection19 May 2026
- 2025EigenScore: OOD Detection using Covariance in Diffusion Models8 Oct 2025
- 2025Pathology-Informed Latent Diffusion Model for Anomaly Detection in Lymph Node Metastasis21 Aug 2025
- 2024Diffusion-based Layer-wise Semantic Reconstruction for Unsupervised Out-of-Distribution Detection16 Nov 2024
- 2024Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling19 Apr 2024
- 2024Approximations to the Fisher Information Metric of Deep Generative Models for Out-Of-Distribution Detection3 Mar 2024
- 2023Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Models5 Dec 2023
- 2023Likelihood-based Out-of-Distribution Detection with Denoising Diffusion Probabilistic Models26 Oct 2023
- 2023Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs6 May 2023
- 2023Unsupervised Out-of-Distribution Detection with Diffusion Inpainting20 Feb 2023
- 2022Denoising diffusion models for out-of-distribution detection14 Nov 2022
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 338
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 215
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2022How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?cited by 128
- 2022Is Out-of-Distribution Detection Learnable?cited by 109
- 2021Can multi-label classification networks know what they don't know?cited by 100
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2021On the Impact of Spurious Correlation for Out-of-distribution Detectioncited by 68
- 2021Hierarchical VAEs Know What They Don't Knowcited by 58
- 2022RankFeat: Rank-1 Feature Removal for Out-of-distribution Detectioncited by 52
12 most cited of 130 All 130 (JSON)
- 2026A Probabilistic Circuit-Induced Pseudo-Metric for Out-of-Distribution Detection10 Aug 2026
- 2026Dual Feature Decoupling for Fine-Grained OOD Detection4 Jun 2026
- 2026Local Diagnostics of Continuous Normalizing Flow for Out-of-Distribution Detection30 May 2026
- 2026The Signal in the Noise: OOD Detection Through Goodness-of-Fit Testing in Factorised Latent Spaces21 May 2026
- 2026Early High-Frequency Injection for Geometry-Sensitive OOD Detection20 May 2026
- 2026Geometry over Density: Few-Shot Cross-Domain OOD Detection5 May 2026
- 2026Mind the Way You Select Negative Texts: Pursuing the Distance Consistency in OOD Detection with VLMs3 Mar 2026
- 2026DAVIS: OOD Detection via Dominant Activations and Variance for Increased Separation30 Jan 2026
- 2025FedSDWC: Federated Synergistic Dual-Representation Weak Causal Learning for OOD12 Nov 2025
- 2025Out of Distribution Detection for Efficient Continual Learning in Quality Prediction for Arc Welding22 Aug 2025
- 2025Generative Adversarial Evasion and Out-of-Distribution Detection for UAV Cyber-Attacks26 Jun 2025
- 2025Enclosing Prototypical Variational Autoencoder for Explainable Out-of-Distribution Detection17 Jun 2025
12 newest of 130 All 130 (JSON)