mlsanityData to 14 Oct 2026

Balanced Energy Regularization Loss for Out-of-distribution Detection

arXiv 2306.10485 ↗First posted 18 Jun 2023cs.CV cs.AI cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/hyunjunChhoi/Balanced_Energy.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 18 Jun 2023.

Builds on

38 of 52 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  4. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  5. 2016Wide Residual Networkscited by 3,070
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  8. 2013Describing Textures in the Wildcited by 2,125
  9. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  10. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  11. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  12. 2020Energy-based Out-of-distribution Detectioncited by 1,299
26 more
  1. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  2. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
  3. 2018Deep Anomaly Detection with Outlier Exposurecited by 942
  4. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
  5. 2020Long-tail learning via logit adjustmentcited by 618
  6. 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
  7. 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
  8. 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
  9. 2020Long-tailed Recognition by Routing Diverse Distribution-Aware Expertscited by 271
  10. 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
  11. 2018Evaluating Bayesian Deep Learning Methods for Semantic Segmentationcited by 143
  12. 2019Detecting the Unexpected via Image Resynthesiscited by 137
  13. 2020Entropy Maximization and Meta Classification for Out-Of-Distribution Detection in Semantic Segmentationcited by 133
  14. 2019The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentationcited by 122
  15. 2020ATOM: Robustifying Out-of-distribution Detection Using Outlier Miningcited by 116
  16. 2021Pixel-wise Anomaly Detection in Complex Driving Scenescited by 109
  17. 2021Semantically Coherent Out-of-Distribution Detectioncited by 107
  18. 2021Influence-Balanced Loss for Imbalanced Visual Classificationcited by 91
  19. 2021Pixel-wise Energy-biased Abstention Learning for Anomaly Segmentation on Complex Urban Driving Scenescited by 83
  20. 2021Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentationcited by 77
  21. 2019Deep Gamblers: Learning to Abstain with Portfolio Theorycited by 71
  22. 2019Simultaneous Semantic Segmentation and Outlier Detection in Presence of Domain Shiftcited by 54
  23. 2018Discriminative out-of-distribution detection for semantic segmentationcited by 47
  24. 2022Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognitioncited by 44
  25. 2022DenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognitioncited by 42
  26. 2022Open-Sampling: Exploring Out-of-Distribution data for Re-balancing Long-tailed datasetscited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 8; 2025: 5; 2026: 1.

16 papers.

Sort:

By area: