# A Distributionally Robust Boosting Algorithm

arXiv: https://arxiv.org/abs/1905.07845 · HTML: https://mlsanity.com/paper/1905.07845/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 May 2019.

## Built on by (most cited first, 3 of 3)

- [Flow-based Distributionally Robust Optimization](https://mlsanity.com/paper/2310.19253/) (2023)
- [On Practical Reinforcement Learning: Provable Robustness, Scalability, and Statistical Efficiency](https://mlsanity.com/paper/2203.01758/) (2022)
- [Distributionally Robust Regularization of Sparse Integer Programming Trained Learning Models](https://mlsanity.com/paper/2311.01994/) (2023)

## Abstract (arXiv)

Distributionally Robust Optimization (DRO) has been shown to provide a flexible framework for decision making under uncertainty and statistical estimation. For example, recent works in DRO have shown that popular statistical estimators can be interpreted as the solutions of suitable formulated data-driven DRO problems. In turn, this connection is used to optimally select tuning parameters in terms of a principled approach informed by robustness considerations. This paper contributes to this growing literature, connecting DRO and statistics, by showing how boosting algorithms can be studied via DRO. We propose a boosting type algorithm, named DRO-Boosting, as a procedure to solve our DRO formulation. Our DRO-Boosting algorithm recovers Adaptive Boosting (AdaBoost) in particular, thus showing that AdaBoost is effectively solving a DRO problem. We apply our algorithm to a financial dataset on credit card default payment prediction. We find that our approach compares favorably to alternative boosting methods which are widely used in practice.
