A Distributionally Robust Framework for Learned Reconstructions in Inverse Problems
Not on the map. Why?
Abstract (arXiv)
Learned reconstruction operators for inverse problems are typically trained under a fixed noise model, and generalize poorly when the distribution during testing differs from the one assumed during training. Distributionally robust optimization (DRO) addresses this by optimizing against the worst-case distribution within a prescribed ambiguity set, but standard Wasserstein DRO perturbs the full joint distribution uniformly, which can be overly conservative and ignores the physics of the measurement process. We develop a structured DRO framework in which the ambiguity set is restricted to structured perturbations aligned with the data-acquisition process. This allows us to learn data-driven reconstruction operators that remain robust to distributional shifts. By constraining perturbations to subsets such as P(Y|X), our framework models uncertainty in the forward operator and noise model more faithfully, accommodating any noise model expressible as a stochastic forward operator. We establish strong duality for this general formulation and derive explicit finite-dimensional dual representations for perturbations in the joint, marginal, and conditional distributions. A central result is an explicit worst-case risk bound that induces Tikhonov regularization on the Lipschitz constant of the reconstruction operator, and is less conservative relative to standard DRO for well-posed problems. Numerical experiments on deblurring and sinogram-to-CT reconstruction demonstrate improved robustness, stability, and interpretability over standard DRO and MSE baselines. In the linear setting, the learned operator becomes effectively low-rank, truncating at the intrinsic dimension of the data and recovering a data-driven analogue of truncated-SVD regularization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 61 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
38 of 61 references.
References · 38
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 433
- 2017Learning Generative Models with Sinkhorn Divergencescited by 314
- 2015Data-driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulationscited by 291
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
- 2017Learned Primal-dual Reconstructioncited by 251
- 2017Image reconstruction by domain transform manifold learningcited by 232
- 2016Distributionally Robust Stochastic Optimization with Wasserstein Distancecited by 185
- 2024A Survey on Diffusion Models for Inverse Problemscited by 180
- 2018Adversarial Regularizers in Inverse Problemscited by 103
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 97
26 more
- 2018NETT: Solving Inverse Problems with Deep Neural Networkscited by 89
- 2017Regularization via Mass Transportationcited by 81
- 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
- 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
- 2020Total Deep Variation for Linear Inverse Problemscited by 53
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 41
- 2021Sinkhorn Distributionally Robust Optimizationcited by 38
- 2024Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matchingcited by 36
- 2021End-to-end reconstruction meets data-driven regularization for inverse problemscited by 32
- 2025Flower: A Flow-Matching Solver for Inverse Problemscited by 27
- 2024Distributionally Robust Optimization and Robust Statisticscited by 24
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Studycited by 15
- 2023Neural-network-based regularization methods for inverse problems in imagingcited by 14
- 2023Convergent regularization in inverse problems and linear plug-and-play denoiserscited by 13
- 2023Unifying Distributionally Robust Optimization via Optimal Transport Theorycited by 13
- 2017Learning to solve inverse problems using Wasserstein losscited by 11
- 2019Bridging Bayesian and Minimax Mean Square Error Estimation via Wasserstein Distributionally Robust Optimizationcited by 11
- 2020Quantifying Model Uncertainty in Inverse Problems via Bayesian Deep Gradient Descentcited by 9
- 20232DeteCT -- A large 2D expandable, trainable, experimental Computed Tomography dataset for machine learningcited by 9
- 2022Tikhonov Regularization is Optimal Transport Robust under Martingale Constraintscited by 6
- 2020A generalized conditional gradient method for dynamic inverse problems with optimal transport regularizationcited by 4
- 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imagingcited by 4
- 2022Distributionally Robust Gaussian Process Regression and Bayesian Inverse Problemscited by 2
- 2025Perturbation-Aware Distributionally Robust Optimization for Inverse Problemscited by 2
- 2025An invertible generative model for forward and inverse problemscited by 2
Built on by
Not cited yet.