mlsanityData to 14 Oct 2026

Distributionally Robust Optimization with Adversarial Data Contamination

arXiv 2507.10718 ↗First posted 14 Jul 2025cs.LG cs.DS math.OCcited by 1

Not on the map. Why?

Abstract (arXiv)

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to simultaneously address both challenges. We focus on optimizing Wasserstein-1 DRO objectives for generalized linear models with convex Lipschitz loss functions, where an ε-fraction of the training data is adversarially corrupted. Our primary contribution lies in a novel modeling framework that integrates robustness against training data contamination with robustness against distributional shifts, alongside an efficient algorithm inspired by robust statistics to solve the resulting optimization problem. We prove that our method achieves an estimation error of O(√ε) for the true DRO objective value using only the contaminated data under the bounded covariance assumption. This work establishes the first rigorous guarantees, supported by efficient computation, for learning under the dual challenges of data contamination and distributional shifts.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 52 references that are in the map. First posted on arXiv 14 Jul 2025.

Builds on

35 of 52 references.

References · 35

  1. 2021Just Train Twice: Improving Group Robustness without Training Group Informationcited by 523
  2. 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 415
  3. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
  4. 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 364
  5. 2018Learning Models with Uniform Performance via Distributionally Robust Optimizationcited by 335
  6. 2016Robust Estimators in High Dimensions without the Computational Intractabilitycited by 209
  7. 2016Distributionally Robust Stochastic Optimization with Wasserstein Distancecited by 185
  8. 2018Sever: A Robust Meta-Algorithm for Stochastic Optimizationcited by 125
  9. 2017Regularization via Mass Transportationcited by 81
  10. 2021DORO: Distributional and Outlier Robust Optimizationcited by 56
  11. 2024Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimizationcited by 53
  12. 2020Outlier Robust Mean Estimation with Subgaussian Rates via Stabilitycited by 50
23 more
  1. 2020Finite-Sample Guarantees for Wasserstein Distributionally Robust Optimization: Breaking the Curse of Dimensionalitycited by 49
  2. 2019Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detectioncited by 41
  3. 2018High-Dimensional Robust Mean Estimation in Nearly-Linear Timecited by 39
  4. 2019Generalized Resilience and Robust Statisticscited by 37
  5. 2023A Finite Sample Complexity Bound for Distributionally Robust Q-learningcited by 36
  6. 2022Doubly Robust Distributionally Robust Off-Policy Evaluation and Learningcited by 34
  7. 2018Optimal Transport Based Distributionally Robust Optimization: Structural Properties and Iterative Schemescited by 30
  8. 2020Class-Weighted Classification: Trade-offs and Robust Approachescited by 30
  9. 2023Robust Generalization against Photon-Limited Corruptions via Worst-Case Sharpness Minimizationcited by 29
  10. 2021Outlier-Robust Optimal Transport: Duality, Structure, and Statistical Analysiscited by 27
  11. 2024Distributionally Robust Optimization and Robust Statisticscited by 24
  12. 2022Streaming Algorithms for High-Dimensional Robust Statisticscited by 21
  13. 2022Holistic Robust Data-Driven Decisionscited by 18
  14. 2023Distributionally Robust Model-based Reinforcement Learning with Large State Spacescited by 17
  15. 2023Outlier-Robust Wasserstein DROcited by 16
  16. 2021Robust Regression Revisited: Acceleration and Improved Estimation Ratescited by 15
  17. 2020Risk-Aware Planning and Assignment for Ground Vehicles using Uncertain Perception from Aerial Vehiclescited by 12
  18. 2020Fast Epigraphical Projection-based Incremental Algorithms for Wasserstein Distributionally Robust Support Vector Machinecited by 10
  19. 2024Wasserstein distributionally robust optimization and its tractable regularization formulationscited by 5
  20. 2024Robust Distribution Learning with Local and Global Adversarial Corruptionscited by 5
  21. 2024Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrievalcited by 5
  22. 2024DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimizationcited by 5
  23. 2024Optimal Robust Estimation under Local and Global Corruptions: Stronger Adversary and Smaller Errorcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.