mlsanityData to 14 Oct 2026

Resource-Adaptive Stochastic Gradient Descent for Online Linear Programming without Re-solving

arXiv 2609.28263 ↗First posted 23 Sep 2026cs.LG math.OCcited by 0

Not on the map. Why?

Abstract (arXiv)

The growth of large language model (LLM) inference and search services increases the scale of online linear programming problems, motivating computationally efficient algorithms. We develop resource-adaptive stochastic gradient descent (RASGD) for stochastic online linear programming. The algorithm uses one request and current inventory to update resource prices, requiring O(m) operations for m resources and memory per arrival and no LP or sample-average optimization. The central idea is to express the current-resource pricing logic of re-solving through a first-order SGD update: each arrival refreshes the remaining-inventory allowance in the dual objective, while the stepsize decreases for early learning and increases later to match the speed of inventory adjustment. Under standard non-degeneracy conditions, our algorithm is feasible on every sample path and achieves O(log T) expected regret against the realized fractional hindsight optimum, which matches the lower bound, even for policies that know the distribution and have unrestricted computation. The analysis converts curvature around the fixed reference price into inventory stability without tracking optimal prices at changing resource levels. Numerical experiments show that RASGD achieves regret competitive with per-arrival LP re-solving and improves upon the tested first-order baselines, while retaining the computational efficiency of first-order methods. These results establish RASGD as a computationally efficient approach to achieving high allocation quality in large-scale OLP.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

13 of 22 references.

References · 13

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  2. 2020Dual Mirror Descent for Online Allocation Problemscited by 52
  3. 2019Online Linear Programming: Dual Convergence, New Algorithms, and Regret Boundscited by 32
  4. 2020Simple and Fast Algorithm for Binary Integer and Online Linear Programmingcited by 27
  5. 2018A Re-solving Heuristic with Uniformly Bounded Loss for Network Revenue Managementcited by 18
  6. 2021An Improved Analysis of LP-based Control for Revenue Managementcited by 13
  7. 2022Degeneracy is OK: Logarithmic Regret for Network Revenue Management with Indiscrete Distributionscited by 13
  8. 2019Logarithmic Regret in Multisecretary and Online Linear Programs with Continuous Valuationscited by 8
  9. 2022Optimal Regularized Online Allocation by Adaptive Re-Solvingcited by 8
  10. 2024Infrequent Resolving Algorithm for Online Linear Programmingcited by 8
  11. 2025Beyond O(√T) Regret: Decoupling Learning and Decision-making in Online Linear Programmingcited by 4
  12. 2025Beyond Non-Degeneracy: Revisiting Certainty Equivalent Heuristic for Online Linear Programmingcited by 3
1 more
  1. 2026Online Linear Programming with Replenishmentcited by 1

Built on by

Not cited yet.