When Does Synthetic Data Augmentation Improve Score-Based Imbalanced Classification?
Not on the map. Why?
Abstract (arXiv)
Synthetic data augmentation is widely used to mitigate class imbalance, but its theoretical effects on score-based classification remain poorly understood. This paper develops a framework for characterizing when synthetic minority augmentation can improve threshold-integrated and threshold-optimized metrics, including AUROC, AUPRC, best-threshold balanced accuracy, and best-threshold (F1) score. We separate the effect of augmentation into two components: a change in effective class weighting and a discrepancy between the synthetic and true minority distributions. Under well-specified score models, the raw estimator already targets the likelihood-ratio ordering, which is population-optimal for the metrics considered. Consequently, augmentation cannot provide a fundamental population-level improvement beyond possible finite-sample variance reduction, and may introduce additional bias through synthetic distributional error. We further establish minimax lower bounds showing that the raw estimator already achieves the optimal metric-regret rate in the well-specified regime. Under misspecification, however, augmentation can play a qualitatively different role: by changing the effective class balance, it can alter the restricted-class projection and correct ranking errors induced by the raw imbalanced objective. We provide explicit improvement bounds quantifying the roles of approximation error, finite-sample estimation error, and synthetic distributional error. Simulation studies corroborate the theory, demonstrating limited gains under well-specification and nontrivial but nonmonotone improvements under misspecification.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 45 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
11 of 45 references.
References · 11
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2024Synthetic Oversampling: Theory and A Practical Approach Using LLMs to Address Data Imbalancecited by 17
- 2025Conditional Data Synthesis Augmentationcited by 8
- 2025GLM Inference with AI-Generated Synthetic Data Using Misspecified Linear Regressioncited by 6
- 2025Bias-Corrected Data Synthesis for Imbalanced Learningcited by 6
- 2024Imbalance-aware Presence-only Loss Function for Species Distribution Modelingcited by 4
- 2025Concentration and excess risk bounds for imbalanced classification with synthetic oversamplingcited by 4
- 2026Synthetic Augmentation in Imbalanced Learning: When It Helps, When It Hurts, and How Much to Addcited by 3
- 2026Classification Imbalance as Transfer Learningcited by 2
- 2026Generative Synthetic Data for Causal Inference: Pitfalls, Remedies, and Opportunitiescited by 2
Built on by
Not cited yet.