mlsanityData to 14 Oct 2026

Synthetic Augmentation in Imbalanced Learning: When It Helps, When It Hurts, and How Much to Add

arXiv 2601.16120 ↗First posted 22 Jan 2026stat.ML cs.LG stat.MEcited by 3

Not on the map. Why?

Abstract (arXiv)

Imbalanced classification often causes standard training procedures to prioritize the majority class and perform poorly on rare but important cases. A classic and widely used remedy is to augment the minority class with synthetic samples, but two basic questions remain under-resolved: when does synthetic augmentation actually help, and how many synthetic samples should be generated? We develop a unified statistical framework for synthetic augmentation in imbalanced learning, studying models trained on imbalanced data augmented with synthetic minority samples. Our theory shows that synthetic data is not always beneficial. In a "local symmetry" regime, imbalance is not the dominant source of error, so adding synthetic samples cannot improve learning rates and can even degrade performance by amplifying generator mismatch. When augmentation can help ("local asymmetry"), the optimal synthetic size depends on generator accuracy and on whether the generator's residual mismatch is directionally aligned with the intrinsic majority-minority shift. This structure can make the best synthetic size deviate from naive full balancing. Practically, we recommend Validation-Tuned Synthetic Size (VTSS): select the synthetic size by minimizing balanced validation loss over a range centered near the fully balanced baseline, while allowing meaningful departures. Extensive simulations and real data analysis further support our findings.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

13 of 34 references.

References · 13

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  4. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  5. 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
  6. 2024Synthetic Oversampling: Theory and A Practical Approach Using LLMs to Address Data Imbalancecited by 17
  7. 2025Conditional Data Synthesis Augmentationcited by 8
  8. 2022Composite Score for Anomaly Detection in Imbalanced Real-World Industrial Datasetcited by 7
  9. 2025GLM Inference with AI-Generated Synthetic Data Using Misspecified Linear Regressioncited by 6
  10. 2025Bias-Corrected Data Synthesis for Imbalanced Learningcited by 6
  11. 2025Concentration and excess risk bounds for imbalanced classification with synthetic oversamplingcited by 4
  12. 2023On Consistent Bayesian Inference from Synthetic Datacited by 2
1 more
  1. 2026Classification Imbalance as Transfer Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.