Long-Tailed Out-of-Distribution Detection: Prioritizing Attention to Tail
Not on the map. Why?
Abstract (arXiv)
Current out-of-distribution (OOD) detection methods typically assume balanced in-distribution (ID) data, while most real-world data follow a long-tailed distribution. Previous approaches to long-tailed OOD detection often involve balancing the ID data by reducing the semantics of head classes. However, this reduction can severely affect the classification accuracy of ID data. The main challenge of this task lies in the severe lack of features for tail classes, leading to confusion with OOD data. To tackle this issue, we introduce a novel Prioritizing Attention to Tail (PATT) method using augmentation instead of reduction. Our main intuition involves using a mixture of von Mises-Fisher (vMF) distributions to model the ID data and a temperature scaling module to boost the confidence of ID data. This enables us to generate infinite contrastive pairs, implicitly enhancing the semantics of ID classes while promoting differentiation between ID and OOD data. To further strengthen the detection of OOD data without compromising the classification performance of ID data, we propose feature calibration during the inference phase. By extracting an attention weight from the training set that prioritizes the tail classes and reduces the confidence in OOD data, we improve the OOD detection capability. Extensive experiments verified that our method outperforms the current state-of-the-art methods on various benchmarks.
Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). Builds on 41 of its 56 references that are in the map. First posted on arXiv 13 Aug 2024.
Builds on
41 of 56 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,021
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,882
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,371
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,340
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,266
- 2013Describing Textures in the Wildcited by 2,115
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,327
29 more
- 2020Energy-based Out-of-distribution Detectioncited by 1,297
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,243
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2018Deep Anomaly Detection with Outlier Exposurecited by 941
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 808
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
- 2020Long-tail learning via logit adjustmentcited by 614
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 510
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2020Understanding the Behaviour of Contrastive Losscited by 397
- 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 360
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
- 2018What is the Effect of Importance Weighting in Deep Learning?cited by 250
- 2020Disentangling Label Distribution for Long-tailed Visual Recognitioncited by 172
- 2022Balanced Contrastive Learning for Long-Tailed Visual Recognitioncited by 144
- 2021Semantically Coherent Out-of-Distribution Detectioncited by 107
- 2019Implicit Semantic Data Augmentation for Deep Networkscited by 106
- 2020Local Temperature Scaling for Probability Calibrationcited by 95
- 2021Improved OOD Generalization via Adversarial Training and Pre-trainingcited by 66
- 2022Sample-dependent Adaptive Temperature Scaling for Improved Calibrationcited by 48
- 2022Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognitioncited by 44
- 2024Probabilistic Contrastive Learning for Long-Tailed Visual Recognitioncited by 42
- 2023Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolationcited by 38
- 2022Open-Sampling: Exploring Out-of-Distribution data for Re-balancing Long-tailed datasetscited by 25
- 2021Imagine by Reasoning: A Reasoning-Based Implicit Semantic Data Augmentation for Long-Tailed Classificationcited by 24
- 2023Out-of-Distribution Detection in Long-Tailed Recognition with Calibrated Outlier Class Learningcited by 23
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Divide, Weight, and Route: Difficulty-Aware Optimization with Dynamic Expert Fusion for Long-tailed Recognitioncited by 1
- 2025Keep It on a Leash: Controllable Pseudo-label Generation Towards Realistic Long-Tailed Semi-Supervised Learningcited by 1
- 2026VMF-GOS: Geometry-guided virtual Outlier Synthesis for Long-Tailed OOD Detectioncited by 0
- 2026MARVEL: Margin-Aware Robust von Mises-Fischer Expert Learning for Long-Tailed Out-of-Distribution Detectioncited by 0
- 2026How Accurate Is Accurate Enough?cited by 0
- 2026Same Loss, Different Gradientscited by 0
- 2026Same Loss, Different Gradients30 Sep 2026
- 2026How Accurate Is Accurate Enough?30 Sep 2026
- 2026MARVEL: Margin-Aware Robust von Mises-Fischer Expert Learning for Long-Tailed Out-of-Distribution Detection2 Jul 2026
- 2026VMF-GOS: Geometry-guided virtual Outlier Synthesis for Long-Tailed OOD Detection5 Feb 2026
- 2025Keep It on a Leash: Controllable Pseudo-label Generation Towards Realistic Long-Tailed Semi-Supervised Learning5 Oct 2025
- 2025Divide, Weight, and Route: Difficulty-Aware Optimization with Dynamic Expert Fusion for Long-tailed Recognition27 Aug 2025