mlsanityData to 14 Oct 2026

Recovering Best Statistical Guarantees via the Empirical Divergence-based Distributionally Robust Optimization

arXiv 1605.09349 ↗First posted 30 May 2016math.OCcited by 33

Not on the map. Why?

Abstract (arXiv)

We investigate the use of distributionally robust optimization (DRO) as a tractable tool to recover the asymptotic statistical guarantees provided by the Central Limit Theorem, for maintaining the feasibility of an expected value constraint under ambiguous probability distributions. We show that using empirically defined Burg-entropy divergence balls to construct the DRO can attain such guarantees. These balls, however, are not reasoned from the standard data-driven DRO framework since by themselves they can have low or even zero probability of covering the true distribution. Rather, their superior statistical performances are endowed by linking the resulting DRO with empirical likelihood and empirical processes. We show that the sizes of these balls can be optimally calibrated using chi-square process excursion. We conduct numerical experiments to support our theoretical findings.

Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 8; 2022: 2; 2023: 13; 2024: 4; 2025: 4; 2026: 2.

33 papers.

Sort:

  1. 2023Diagnosing Model Performance Under Distribution Shiftcited by 39
  2. 2023A Finite Sample Complexity Bound for Distributionally Robust Q-learningcited by 36
  3. 2021On the Optimality of Batch Policy Optimization Algorithmscited by 28
  4. 2021Statistical Analysis of Wasserstein Distributionally Robust Estimatorscited by 27
  5. 2022Holistic Robust Data-Driven Decisionscited by 18
  6. 2021Sequential Domain Adaptation by Synthesizing Distributionally Robust Expertscited by 14
  7. 2023Unifying Distributionally Robust Optimization via Optimal Transport Theorycited by 13
  8. 2023Certified Robust Neural Networks: Generalization and Corruption Resistancecited by 11
  9. 2021Generalization Bounds with Minimal Dependency on Hypothesis Class via Distributionally Robust Optimizationcited by 9
  10. 2022Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictionscited by 8
  11. 2023Nash Equilibria, Regularization and Computation in Optimal Transport-Based Distributionally Robust Optimizationcited by 8
  12. 2021Learning and Decision-Making with Data: Optimal Formulations and Phase Transitionscited by 7
21 more
  1. 2023Smoothed f-Divergence Distributionally Robust Optimizationcited by 7
  2. 2024Distributionally Robust Performative Predictioncited by 7
  3. 2023Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimizationcited by 6
  4. 2023Estimation Beyond Data Reweighting: Kernel Method of Momentscited by 5
  5. 2024Evaluating Model Performance Under Worst-case Subpopulationscited by 5
  6. 2025DRO: A Python Library for Distributionally Robust Optimization in Machine Learningcited by 5
  7. 2021A data-driven approach to beating SAA out-of-samplecited by 3
  8. 2025Nested Stochastic Algorithm for Generalized Sinkhorn distance-Regularized Distributionally Robust Optimizationcited by 3
  9. 2021Model Uncertainty and Correctability for Directed Graphical Modelscited by 2
  10. 2023Optimal Transport Regularized Divergences: Application to Adversarial Robustnesscited by 2
  11. 2021Efficient Data-Driven Optimization with Noisy Datacited by 1
  12. 2023Optimal Confidence Intervals via Moderate Deviations Theorycited by 1
  13. 2024Geometry-Aware Instrumental Variable Regressioncited by 1
  14. 2024From Distributional Robustness to Robust Statistics: A Confidence Sets Perspectivecited by 1
  15. 2023Calibrated Data-Dependent Constraints with Exact Satisfaction Guaranteescited by 0
  16. 2023Robust Data-driven Prescriptiveness Optimizationcited by 0
  17. 2023Distributionally Robust Skeleton Learning of Discrete Bayesian Networkscited by 0
  18. 2025Provable Robust Overfitting Mitigation in Wasserstein Distributionally Robust Optimizationcited by 0
  19. 2025Mixed-feature Logistic Regression Robust to Distribution Shiftscited by 0
  20. 2026Statistical Guarantees for Distributionally Robust Optimization with Optimal Transport and OT-Regularized Divergencescited by 0
  21. 2026From Dual Tracking to Clipping: Provably Faster Distributionally Robust Multi-Objective Optimizationcited by 0