mlsanityData to 7 Oct 2026

Ultra-imbalanced classification guided by statistical information

arXiv 2409.04101 ↗First posted 6 Sep 2024cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Imbalanced data are frequently encountered in real-world classification tasks. Previous works on imbalanced learning mostly focused on learning with a minority class of few samples. However, the notion of imbalance also applies to cases where the minority class contains abundant samples, which is usually the case for industrial applications like fraud detection in the area of financial risk management. In this paper, we take a population-level approach to imbalanced learning by proposing a new formulation called ultra-imbalanced classification (UIC). Under UIC, loss functions behave differently even if infinite amount of training samples are available. To understand the intrinsic difficulty of UIC problems, we borrow ideas from information theory and establish a framework to compare different loss functions through the lens of statistical information. A novel learning objective termed Tunable Boosting Loss is developed which is provably resistant against data imbalance under UIC, as well as being empirically efficient verified by extensive experimental studies on both public and industrial datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 6 Sep 2024.

Builds on

19 of 36 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  3. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
  4. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
  5. 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
  6. 2020Long-tail learning via logit adjustmentcited by 605
  7. 2021Deep Long-Tailed Learning: A Surveycited by 416
  8. 2020Asymmetric Loss For Multi-Label Classificationcited by 379
  9. 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
  10. 2018Gradient Harmonized Single-stage Detectorcited by 114
  11. 2020Equalization Loss v2: A New Gradient Balance Approach for Long-tailed Object Detectioncited by 99
  12. 2020Identifying and Compensating for Feature Deviation in Imbalanced Deep Learningcited by 76
7 more
  1. 2021Label-Imbalanced and Group-Sensitive Classification under Overparameterizationcited by 74
  2. 2022PolyLoss: A Polynomial Expansion Perspective of Classification Loss Functionscited by 62
  3. 2022Equalized Focal Loss for Dense Long-Tailed Object Detectioncited by 46
  4. 2022Understanding Why Generalized Reweighting Does Not Improve Over ERMcited by 29
  5. 2022Open-Sampling: Exploring Out-of-Distribution data for Re-balancing Long-tailed datasetscited by 25
  6. 2019A Tunable Loss Function for Robust Classification: Calibration, Landscape, and Generalizationcited by 23
  7. 2021Is Importance Weighting Incompatible with Interpolating Classifiers?cited by 19

Built on by

Not cited yet.