# Synthetic Augmentation in Imbalanced Learning: When It Helps, When It Hurts, and How Much to Add

arXiv: https://arxiv.org/abs/2601.16120 · HTML: https://mlsanity.com/paper/2601.16120/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 34 references that are in the map.
- First posted on arXiv 22 Jan 2026.

## Builds on (most cited first, 13 of 13)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [mixup: Beyond Empirical Risk Minimization](https://mlsanity.com/paper/1710.09412/) (2017)
- [Normalizing Flows for Probabilistic Modeling and Inference](https://mlsanity.com/paper/1912.02762/) (2019)
- [Generative models improve fairness of medical classifiers under distribution shifts](https://mlsanity.com/paper/2304.09218/) (2023)
- [Synthetic Oversampling: Theory and A Practical Approach Using LLMs to Address Data Imbalance](https://mlsanity.com/paper/2406.03628/) (2024)
- [Conditional Data Synthesis Augmentation](https://mlsanity.com/paper/2504.07426/) (2025)
- [Composite Score for Anomaly Detection in Imbalanced Real-World Industrial Dataset](https://mlsanity.com/paper/2211.15513/) (2022)
- [GLM Inference with AI-Generated Synthetic Data Using Misspecified Linear Regression](https://mlsanity.com/paper/2503.21968/) (2025)
- [Bias-Corrected Data Synthesis for Imbalanced Learning](https://mlsanity.com/paper/2510.26046/) (2025)
- [Concentration and excess risk bounds for imbalanced classification with synthetic oversampling](https://mlsanity.com/paper/2510.20472/) (2025)
- [On Consistent Bayesian Inference from Synthetic Data](https://mlsanity.com/paper/2305.16795/) (2023)
- [Classification Imbalance as Transfer Learning](https://mlsanity.com/paper/2601.10630/) (2026)

## Built on by (most cited first, 3 of 3)

- [Maximum Likelihood Estimation for Entity Ranking under Iterative Synthetic Data Augmentation](https://mlsanity.com/paper/2609.32987/) (2026)
- [When Does Synthetic Data Augmentation Improve Score-Based Imbalanced Classification?](https://mlsanity.com/paper/2606.26053/) (2026)
- [Learning a Size-Weight Frontier for Synthetic-Augmented Inference](https://mlsanity.com/paper/2608.28576/) (2026)

## Abstract (arXiv)

Imbalanced classification often causes standard training procedures to prioritize the majority class and perform poorly on rare but important cases. A classic and widely used remedy is to augment the minority class with synthetic samples, but two basic questions remain under-resolved: when does synthetic augmentation actually help, and how many synthetic samples should be generated? We develop a unified statistical framework for synthetic augmentation in imbalanced learning, studying models trained on imbalanced data augmented with synthetic minority samples. Our theory shows that synthetic data is not always beneficial. In a "local symmetry" regime, imbalance is not the dominant source of error, so adding synthetic samples cannot improve learning rates and can even degrade performance by amplifying generator mismatch. When augmentation can help ("local asymmetry"), the optimal synthetic size depends on generator accuracy and on whether the generator's residual mismatch is directionally aligned with the intrinsic majority-minority shift. This structure can make the best synthetic size deviate from naive full balancing. Practically, we recommend Validation-Tuned Synthetic Size (VTSS): select the synthetic size by minimizing balanced validation loss over a range centered near the fully balanced baseline, while allowing meaningful departures. Extensive simulations and real data analysis further support our findings.