Finite and Corruption-Robust Regret Bounds in Online Inverse Linear Optimization under M-Convex Action Sets
Not on the map. Why?
Abstract (arXiv)
We study online inverse linear optimization, also known as contextual recommendation, where a learner sequentially infers an agent's hidden objective vector from observed optimal actions over feasible sets that change over time. The learner aims to recommend actions that perform well under the agent's true objective, and the performance is measured by the regret, defined as the cumulative gap between the agent's optimal values and those achieved by the learner's recommended actions. Prior work has established a regret bound of O(dlog T), as well as a finite but exponentially large bound of exp(O(dlog d)), where d is the dimension of the optimization problem and T is the time horizon, while a regret lower bound of Omega(d) is known (Gollapudi et al. 2021; Sakaue et al. 2025). Whether a finite regret bound polynomial in d is achievable or not has remained an open question. We partially resolve this by showing that when the feasible sets are M-convex -- a broad class that includes matroids -- a finite regret bound of O(dlog d) is possible. We achieve this by combining a structural characterization of optimal solutions on M-convex sets with a geometric volume argument. Moreover, we extend our approach to adversarially corrupted feedback in up to C rounds. We obtain a regret bound of O((C+1)dlog d) without prior knowledge of C, by monitoring directed graphs induced by the observed feedback to detect corruptions adaptively.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 18 of its 41 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
18 of 41 references.
References · 18
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2021Inverse Optimization: Theory and Applicationscited by 48
- 2015Statistical Query Algorithms for Mean Vector Estimation and Stochastic Convex Optimizationcited by 41
- 2015Inverse Optimization with Noisy Datacited by 34
- 2015Data-driven Inverse Optimization with Imperfect Informationcited by 33
- 2013Data-Driven Estimation in Equilibrium Using Inverse Optimizationcited by 32
- 2018Contextual Search via Intrinsic Volumescited by 26
- 2021Contextual Inverse Optimization: Offline and Online Learningcited by 20
- 2018An Online-Learning Approach to Inverse Optimizationcited by 16
- 2021Contextual Recommendations and Low-Regret Cutting-Plane Algorithmscited by 14
- 2023Maximum Optimality Margin: A Unified Approach for Contextual Linear Programming and Inverse Linear Programmingcited by 13
6 more
- 2020Online Convex Optimization Perspective for Learning from Dynamically Revealed Preferencescited by 7
- 2025Revisiting Online Learning Approach to Inverse Linear Optimization: A Fenchel-Young Loss Perspective and Gap-Dependent Regret Analysiscited by 7
- 2025Online Inverse Linear Optimization: Efficient Logarithmic-Regret Algorithm, Robustness to Suboptimality, and Lower Boundcited by 7
- 2022Density-Based Algorithms for Corruption-Robust Contextual Search and Convex Optimizationcited by 4
- 2023Faster Discrete Convex Function Minimization with Predictions: The M-Convex Casecited by 3
- 2024No-Regret Mnatural-Concave Function Maximization: Stochastic Bandit Algorithms and Hardness of Adversarial Full-Information Settingcited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Simple Projection-Free Algorithm for Contextual Recommendation with Logarithmic Regret and Robustnesscited by 4
- 2026Multiscale Reward Hedging from Correct Demonstrationscited by 3
- 2026Efficient Online Inverse Optimization with O(d) Regretcited by 2
- 2026Explicit Iteration Complexity of Exact Data-Driven Inverse Optimization for Integer Linear Programscited by 1
- 2026Tight Regret Bound for Online Inverse Linear Optimization via Multiscale Matrix Weightscited by 1
- 2026Cogentic: Multi-Agent Orchestration for Automated Proof Discoverycited by 0
- 2026Cogentic: Multi-Agent Orchestration for Automated Proof Discovery30 Sep 2026
- 2026Tight Regret Bound for Online Inverse Linear Optimization via Multiscale Matrix Weights22 Sep 2026
- 2026Efficient Online Inverse Optimization with O(d) Regret11 Sep 2026
- 2026Multiscale Reward Hedging from Correct Demonstrations7 Aug 2026
- 2026Explicit Iteration Complexity of Exact Data-Driven Inverse Optimization for Integer Linear Programs24 Jul 2026
- 2026Simple Projection-Free Algorithm for Contextual Recommendation with Logarithmic Regret and Robustness21 Mar 2026