Constrained Online Learning with Noisy Constraint Values
Not on the map. Why?
Abstract (arXiv)
We study constrained online convex optimization with adversarial constraints and conditionally unbiased, finite-variance observations of constraint values and gradients. Under common feasibility, our LEDGER algorithm attains O(√ T) expected regret and O(√Tlog(eT)) expected budget violation, the largest cumulative overspend over any window. It uses a reflected exponential potential, clipped signed observations, and predictable adaptive regularization, with one feedback triple and one projection per round. Neither a Slater condition, independence between feedback channels, nor an absolute constraint-value bound is needed. A Gaussian testing lower bound proves that the budget rate has optimal horizon dependence under square-root regret at fixed positive noise, including the logarithm. The same obstruction holds for terminal violation, so the logarithm is not a cost of maximizing over windows; an O(√ T) budget bound instead forces linear regret. In contrast, fixed positive Gaussian value noise yields a joint regret--hard-violation lower bound of Omega(minσ,1T/log2 T), even with exact gradients in one dimension. The hard-violation construction matches arbitrarily many moments while preserving a feasible-endpoint gap and constant endpoint probabilities. Together, the bounds separate uncertainty about hard feasibility from learnable signed budgets. Deterministic restarts remove the horizon input without changing either upper rate.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
29 of 46 references.
References · 29
- 2021Convex optimizationcited by 2,479
- 2013Bandits with Knapsackscited by 163
- 2018Adaptive Online Learning in Dynamic Environmentscited by 130
- 2017Online Convex Optimization with Stochastic Constraintscited by 94
- 2014Bandits with concave rewards and convex knapsackscited by 83
- 2018Adversarial Bandits with Knapsackscited by 73
- 2015Adaptive Algorithms for Online Convex Optimization with Long-term Constraintscited by 65
- 2017Online Convex Optimization with Time-Varying Constraintscited by 55
- 2018Online convex optimization for cumulative constraintscited by 47
- 2022A Unifying Framework for Online Optimization with Long-Term Constraintscited by 41
- 2021Regret and Cumulative Constraint Violation Analysis for Online Convex Optimization with Long Term Constraintscited by 38
- 2023Optimal Algorithms for Online Convex Optimization with Adversarial Constraintscited by 33
17 more
- 2019Online Primal-Dual Mirror Descent under Stochastic Constraintscited by 31
- 2021Regret and Cumulative Constraint Violation Analysis for Distributed Online Constrained Convex Optimizationcited by 21
- 2019Chasing Convex Bodies Optimallycited by 18
- 2019Safe Convex Learning under Uncertain Constraintscited by 17
- 2019Chasing Convex Bodies with Linear Competitive Ratiocited by 15
- 2021Safe Online Convex Optimization with Unknown Linear Safety Constraintscited by 13
- 2021Simultaneously Achieving Sublinear Regret and Constraint Violations for Online Convex Optimization with Time-varying Constraintscited by 12
- 2024An Optimistic Algorithm for Online Convex Optimization with Adversarial Constraintscited by 11
- 2023BanditQ: Fair Bandits with Guaranteed Rewardscited by 6
- 2025No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!cited by 5
- 2024A Unified Framework for Analyzing Meta-algorithms in Online Convex Optimizationcited by 4
- 2026A Geometric Approach to Constrained Online Learningcited by 4
- 2025BAGEL: Adversarially Constrained Online Convex Optimization under Separation Oracle Accesscited by 3
- 2025Universal Dynamic Regret and Constraint Violation Bounds for Constrained Online Convex Optimizationcited by 3
- 2026Breaking the O(√T) Cumulative Constraint Violation Barrier while Achieving O(√T) Static Regret in Constrained Online Convex Optimizationcited by 3
- 2026Constrained Online Convex Optimization without Slater's Conditioncited by 1
- 2026Online Convex Optimization with Dueling Feedbackcited by 1
Built on by
Not cited yet.