mlsanityData to 14 Oct 2026

Beyond Synthetic Augmentation: Group-Aware Threshold Calibration for Robust Balanced Accuracy in Imbalanced Learning

arXiv 2509.02592 ↗First posted 29 Aug 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Class imbalance remains a fundamental challenge in machine learning, with traditional solutions often creating as many problems as they solve. We demonstrate that group-aware threshold calibration--setting different decision thresholds for different demographic groups--provides superior robustness compared to synthetic data generation methods. Through extensive experiments, we show that group-specific thresholds achieve 1.5-4% higher balanced accuracy than SMOTE and CT-GAN augmented models while improving worst-group balanced accuracy. Unlike single-threshold approaches that apply one cutoff across all groups, our group-aware method optimizes the Pareto frontier between balanced accuracy and worst-group balanced accuracy, enabling fine-grained control over group-level performance. Critically, we find that applying group thresholds to synthetically augmented data yields minimal additional benefit, suggesting these approaches are fundamentally redundant. Our results span seven model families including linear, tree-based, instance-based, and boosting methods, confirming that group-aware threshold calibration offers a simpler, more interpretable, and more effective solution to class imbalance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 16 references that are in the map. First posted on arXiv 29 Aug 2025.

Builds on

8 of 16 references.

References · 8

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  2. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
  3. 2019Modeling Tabular data using Conditional GANcited by 699
  4. 2021Just Train Twice: Improving Group Robustness without Training Group Informationcited by 523
  5. 2017Algorithmic decision making and the cost of fairnesscited by 403
  6. 2020Conditional Wasserstein GAN-based Oversampling of Tabular Data for Imbalanced Learningcited by 67
  7. 2024OxonFair: A Flexible Toolkit for Algorithmic Fairnesscited by 12
  8. 2022Stop Oversampling for Class Imbalance Learning: A Critical Reviewcited by 4

Built on by

Not cited yet.