mlsanityData to 13 Oct 2026

Long-Tailed Out-of-Distribution Detection: Prioritizing Attention to Tail

arXiv 2408.06742 ↗First posted 13 Aug 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Current out-of-distribution (OOD) detection methods typically assume balanced in-distribution (ID) data, while most real-world data follow a long-tailed distribution. Previous approaches to long-tailed OOD detection often involve balancing the ID data by reducing the semantics of head classes. However, this reduction can severely affect the classification accuracy of ID data. The main challenge of this task lies in the severe lack of features for tail classes, leading to confusion with OOD data. To tackle this issue, we introduce a novel Prioritizing Attention to Tail (PATT) method using augmentation instead of reduction. Our main intuition involves using a mixture of von Mises-Fisher (vMF) distributions to model the ID data and a temperature scaling module to boost the confidence of ID data. This enables us to generate infinite contrastive pairs, implicitly enhancing the semantics of ID classes while promoting differentiation between ID and OOD data. To further strengthen the detection of OOD data without compromising the classification performance of ID data, we propose feature calibration during the inference phase. By extracting an attention weight from the training set that prioritizes the tail classes and reduces the confidence in OOD data, we improve the OOD detection capability. Extensive experiments verified that our method outperforms the current state-of-the-art methods on various benchmarks.

Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). Builds on 41 of its 56 references that are in the map. First posted on arXiv 13 Aug 2024.

Builds on

41 of 56 references.

References · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,021
  6. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,882
  7. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,371
  8. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,340
  9. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,266
  10. 2013Describing Textures in the Wildcited by 2,115
  11. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  12. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,327
29 more
  1. 2020Energy-based Out-of-distribution Detectioncited by 1,297
  2. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,243
  3. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
  4. 2018Deep Anomaly Detection with Outlier Exposurecited by 941
  5. 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 808
  6. 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
  7. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
  8. 2020Long-tail learning via logit adjustmentcited by 614
  9. 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 510
  10. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  11. 2020Understanding the Behaviour of Contrastive Losscited by 397
  12. 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 360
  13. 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
  14. 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
  15. 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
  16. 2018What is the Effect of Importance Weighting in Deep Learning?cited by 250
  17. 2020Disentangling Label Distribution for Long-tailed Visual Recognitioncited by 172
  18. 2022Balanced Contrastive Learning for Long-Tailed Visual Recognitioncited by 144
  19. 2021Semantically Coherent Out-of-Distribution Detectioncited by 107
  20. 2019Implicit Semantic Data Augmentation for Deep Networkscited by 106
  21. 2020Local Temperature Scaling for Probability Calibrationcited by 95
  22. 2021Improved OOD Generalization via Adversarial Training and Pre-trainingcited by 66
  23. 2022Sample-dependent Adaptive Temperature Scaling for Improved Calibrationcited by 48
  24. 2022Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognitioncited by 44
  25. 2024Probabilistic Contrastive Learning for Long-Tailed Visual Recognitioncited by 42
  26. 2023Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolationcited by 38
  27. 2022Open-Sampling: Exploring Out-of-Distribution data for Re-balancing Long-tailed datasetscited by 25
  28. 2021Imagine by Reasoning: A Reasoning-Based Implicit Semantic Data Augmentation for Long-Tailed Classificationcited by 24
  29. 2023Out-of-Distribution Detection in Long-Tailed Recognition with Calibrated Outlier Class Learningcited by 23

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.