Heatmap-based Out-of-Distribution Detection
Not on the map. Why?
Abstract (arXiv)
Our work investigates out-of-distribution (OOD) detection as a neural network output explanation problem. We learn a heatmap representation for detecting OOD images while visualizing in- and out-of-distribution image regions at the same time. Given a trained and fixed classifier, we train a decoder neural network to produce heatmaps with zero response for in-distribution samples and high response heatmaps for OOD samples, based on the classifier features and the class prediction. Our main innovation lies in the heatmap definition for an OOD sample, as the normalized difference from the closest in-distribution sample. The heatmap serves as a margin to distinguish between in- and out-of-distribution samples. Our approach generates the heatmaps not only for OOD detection, but also to indicate in- and out-of-distribution regions of the input image. In our evaluations, our approach mostly outperforms the prior work on fixed classifiers, trained on CIFAR-10, CIFAR-100 and Tiny ImageNet. The code is publicly available at: https://github.com/jhornauer/heatmap_ood.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 15 Nov 2022.
Builds on
28 of 38 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Wide Residual Networkscited by 3,057
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2013Describing Textures in the Wildcited by 2,110
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
16 more
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
- 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
- 2020Explainable Deep One-Class Classificationcited by 126
- 2018Attention Branch Network: Learning of Attention Mechanism for Visual Explanationcited by 108
- 2021Semantically Coherent Out-of-Distribution Detectioncited by 107
- 2018Generative Probabilistic Novelty Detection with Adversarial Autoencoderscited by 99
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2020A Generic and Model-Agnostic Exemplar Synthetization Framework for Explainable AIcited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 2; 2026: 2.
9 papers.
- 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimationcited by 17
- 2024Revisiting Out-of-Distribution Detection in LiDAR-based 3D Object Detectioncited by 11
- 2023Out-of-Distribution Detection for Monocular Depth Estimationcited by 7
- 2025Uncertainty-Aware Likelihood Ratio Estimation for Pixel-Wise Out-of-Distribution Detectioncited by 3
- 2024FlowCon: Out-of-Distribution Detection using Flow-Based Contrastive Learningcited by 2
- 2025Out-of-Distribution Detection in LiDAR Semantic Segmentation Using Epistemic Uncertainty from Hierarchical GMMscited by 2
- 2023MaskSearch: Querying Image Masks at Scalecited by 0
- 2026ALOOD: Exploiting Language Representations for LiDAR-based Out-of-Distribution Object Detectioncited by 0
- 2026Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Predictioncited by 0
- 2026Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Prediction14 Apr 2026
- 2026ALOOD: Exploiting Language Representations for LiDAR-based Out-of-Distribution Object Detection9 Mar 2026
- 2025Out-of-Distribution Detection in LiDAR Semantic Segmentation Using Epistemic Uncertainty from Hierarchical GMMs8 Oct 2025
- 2025Uncertainty-Aware Likelihood Ratio Estimation for Pixel-Wise Out-of-Distribution Detection1 Aug 2025
- 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimation29 Nov 2024
- 2024FlowCon: Out-of-Distribution Detection using Flow-Based Contrastive Learning3 Jul 2024
- 2024Revisiting Out-of-Distribution Detection in LiDAR-based 3D Object Detection24 Apr 2024
- 2023Out-of-Distribution Detection for Monocular Depth Estimation11 Aug 2023
- 2023MaskSearch: Querying Image Masks at Scale3 May 2023