mlsanityData to 7 Oct 2026

Smooth Learning with Hard Constraints via Legendre-Regularized Policies

arXiv 2607.24007 ↗First posted 27 Jul 2026math.OC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We revisit contextual optimization from the perspective of policy class design. A desirable policy class should be expressive enough to learn rich context-decision relationships, should enforce hard feasibility constraints rather than soft penalty terms, and should remain smooth enough for gradient-based training on downstream decision losses. Existing approaches usually emphasize only part of these requirements. We propose Legendre-regularized policies, which parameterize decisions as solutions of regularized optimization problems over the original feasible region. This construction yields policies that are feasible by construction and differentiable with respect to learned latent parameters. We prove that the associated optimizer map is single-valued, maps onto the relative interior of the feasible set, admits an explicit Jacobian, is Lipschitz continuous, and can be made arbitrarily smooth. We also establish a universal approximation result showing that the proposed class can approximate any continuous feasible policy on compact context sets. The framework unifies explicitly regularized optimizers and implicit perturbation-based smooth optimizers. Experiments on contextual newsvendor and resource allocation problems show that our approach improves prescriptive performance relative to the benchmark methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

24 of 39 references.

References · 24

  1. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
  2. 2019Differentiable Convex Optimization Layerscited by 458
  3. 2017Smart "Predict, then Optimize"cited by 332
  4. 2018Melding the Data-Decisions Pipeline: Decision-Focused Learning for Combinatorial Optimizationcited by 220
  5. 2014From Predictive to Prescriptive Analyticscited by 142
  6. 2019Learning with Fenchel-Young Lossescited by 117
  7. 2019Smart Predict-and-Optimize for Hard Combinatorial Optimization Problemscited by 88
  8. 2020Learning with Differentiable Perturbed Optimizerscited by 81
  9. 2018SparseMAP: Differentiable Sparse Structured Inferencecited by 62
  10. 2020Decision Trees for Decision-Making under the Predict-then-Optimize Frameworkcited by 52
  11. 2021Nonsmooth Implicit Differentiation for Machine Learning and Optimizationcited by 43
  12. 2023End-to-End Feasible Optimization Proxies for Large-Scale Economic Dispatchcited by 35
12 more
  1. 2021Risk Bounds and Calibration for a Smart Predict-then-Optimize Methodcited by 28
  2. 2016Applying Deep Learning to the Newsvendor Problemcited by 24
  3. 2014Online Linear Optimization via Smoothingcited by 23
  4. 2020Stochastic Optimization Forestscited by 20
  5. 2020Residuals-based distributionally robust optimization with covariate informationcited by 20
  6. 2023Calibration by Distribution Matching: Trainable Kernel Calibration Metricscited by 20
  7. 2019Dynamic optimization with side informationcited by 14
  8. 2022Data-Driven Sample Average Approximation with Covariate Informationcited by 14
  9. 2021On Data-Driven Prescriptive Analytics with Side Information: A Regularized Nadaraya-Watson Approachcited by 12
  10. 2023Data-driven Piecewise Affine Decision Rules for Stochastic Programming with Covariate Informationcited by 4
  11. 2026Soft-Radial Projection for Constrained End-to-End Learningcited by 3
  12. 2023Mind the (optimality) Gap: A Gap-Aware Learning Rate Scheduler for Adversarial Netscited by 2

Built on by

Not cited yet.