# The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regression

arXiv: https://arxiv.org/abs/2202.09101 · HTML: https://mlsanity.com/paper/2202.09101/

## Key facts

- Cited by 28 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Feb 2022.

## Built on by (most cited first, 28 of 28)

- [Position: Why We Must Rethink Empirical Research in Machine Learning](https://mlsanity.com/paper/2405.02200/) (2024)
- [HoTPP Benchmark: Are We Good at the Long Horizon Events Forecasting?](https://mlsanity.com/paper/2406.14341/) (2024)
- [An Experimental Study on the Rashomon Effect of Balancing Methods in Imbalanced Classification](https://mlsanity.com/paper/2405.01557/) (2024)
- [Uncertainty quantification for probabilistic machine learning in earth observation using conformal prediction](https://mlsanity.com/paper/2401.06421/) (2024)
- [Investigating the Impact of Balancing, Filtering, and Complexity on Predictive Multiplicity: A Data-Centric Perspective](https://mlsanity.com/paper/2412.09712/) (2024)
- [When Personalization Harms: Reconsidering the Use of Group Attributes in Prediction](https://mlsanity.com/paper/2206.02058/) (2022)
- [Bias-Corrected Data Synthesis for Imbalanced Learning](https://mlsanity.com/paper/2510.26046/) (2025)
- [Rethinking Class Imbalance in Machine Learning](https://mlsanity.com/paper/2305.03900/) (2023)
- [Improving Clinical Decision Support through Interpretable Machine Learning and Error Handling in Electronic Health Records](https://mlsanity.com/paper/2308.10781/) (2023)
- [missForestPredict -- Missing data imputation for prediction settings](https://mlsanity.com/paper/2407.03379/) (2024)
- [Improving probabilistic forecasts of extreme wind speeds by training statistical post-processing models with weighted scoring rules](https://mlsanity.com/paper/2407.15900/) (2024)
- [E2MoCase: A Dataset for Emotional, Event and Moral Observations in News Articles on High-impact Legal Cases](https://mlsanity.com/paper/2409.09001/) (2024)
- [Enhancing Clinical Predictive Modeling through Model Complexity-Driven Class Proportion Tuning for Class Imbalanced Data: An Empirical Study on Opioid Overdose Prediction](https://mlsanity.com/paper/2305.05722/) (2023)
- [Likelihood-ratio-based confidence intervals for neural networks](https://mlsanity.com/paper/2308.02221/) (2023)
- [An engine to simulate insurance fraud network data](https://mlsanity.com/paper/2308.11659/) (2023)
- [Explainable bank failure prediction models: Counterfactual explanations to reduce the failure risk](https://mlsanity.com/paper/2407.11089/) (2024)
- [Synthetic Data Generation and Automated Multidimensional Data Labeling for AI/ML in General and Circular Coordinates](https://mlsanity.com/paper/2409.02079/) (2024)
- [Attention-Based Synthetic Data Generation for Calibration-Enhanced Survival Analysis: A Case Study for Chronic Kidney Disease Using Electronic Health Records](https://mlsanity.com/paper/2503.06096/) (2025)
- [Is augmentation effective to improve prediction in imbalanced text datasets?](https://mlsanity.com/paper/2304.10283/) (2023)
- [Nine tips for ecologists using machine learning](https://mlsanity.com/paper/2305.10472/) (2023)
- [Federated Diabetes Prediction in Canadian Adults Using Real-world Cross-Province Primary Care Data](https://mlsanity.com/paper/2408.12029/) (2024)
- [A weighted-likelihood framework for class imbalance in Bayesian prediction models](https://mlsanity.com/paper/2504.17013/) (2025)
- [Predicting Multi-Type Talented Students in Secondary School Using Semi-Supervised Machine Learning](https://mlsanity.com/paper/2509.00863/) (2025)
- [CNN-ViT Hybrid for Pneumonia Detection: Theory and Empiric on Limited Data without Pretraining](https://mlsanity.com/paper/2509.08586/) (2025)
- [Tipping the Balance: Impact of Class Imbalance Correction on the Performance of Clinical Risk Prediction Models](https://mlsanity.com/paper/2603.00208/) (2026)
- [A Systematic Evaluation of Imbalance Handling Methods in Biomedical Binary Classification](https://mlsanity.com/paper/2605.14147/) (2026)
- [Machine Learning for Pre-Culture ESBL Risk Stratification to Guide Empiric Antibiotic Selection: A 12-Hospital Study of Enterobacteriaceae Cultures](https://mlsanity.com/paper/2609.05970/) (2026)
- [Protocol Choices Matter More Than the Aggregation Algorithm: Federated Learning for In-Hospital Mortality Prediction in Care-Unit and Multi-Hospital Federations](https://mlsanity.com/paper/2610.17265/) (2026)

## Abstract (arXiv)

Methods to correct class imbalance, i.e. imbalance between the frequency of outcome events and non-events, are receiving increasing interest for developing prediction models. We examined the effect of imbalance correction on the performance of standard and penalized (ridge) logistic regression models in terms of discrimination, calibration, and classification. We examined random undersampling, random oversampling and SMOTE using Monte Carlo simulations and a case study on ovarian cancer diagnosis. The results indicated that all imbalance correction methods led to poor calibration (strong overestimation of the probability to belong to the minority class), but not to better discrimination in terms of the area under the receiver operating characteristic curve. Imbalance correction improved classification in terms of sensitivity and specificity, but similar results were obtained by shifting the probability threshold instead. Our study shows that outcome imbalance is not a problem in itself, and that imbalance correction may even worsen model performance.