Blind Dynamic Resource Allocation in Closed Networks via Mirror Backpressure
Not on the map. Why?
Abstract (arXiv)
We study the problem of maximizing payoff generated over a period of time in a general class of closed queueing networks with a finite, fixed number of supply units which circulate in the system. Demand arrives stochastically, and serving a demand unit (customer) causes a supply unit to relocate from the ``origin'' to the ``destination'' of the customer. The key challenge is to manage the distribution of supply in the network. We consider general controls including customer entry control, pricing, and assignment. Motivating applications include shared transportation platforms and scrip systems. Inspired by the mirror descent algorithm for optimization and the backpressure policy for network control, we introduce a rich family of Mirror Backpressure (MBP) control policies. The MBP policies are simple and practical, and crucially do not need any statistical knowledge of the demand (customer) arrival rates (these rates are permitted to vary in time). Under mild conditions, we propose MBP policies that are provably near optimal. Specifically, our policies lose at most O(fracKT+frac1K + √η K) payoff per customer relative to the optimal policy that knows the demand arrival rates, where K is the number of supply units, T is the total number of customers over the time horizon, and η is the demand process' average rate of change per customer arrival. An adaptation of MBP is found to perform well in numerical experiments based on data from ride-hailing.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 0; 2025: 4.
6 papers.
- 2021Learning and Information in Stochastic Networks and Queuescited by 8
- 2025No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!cited by 5
- 2025Decision-Focused Bias Correction for Fluid Approximationcited by 3
- 2023Restarted Bayesian Online Change-point Detection for Non-Stationary Markov Decision Processescited by 2
- 2025Natural Policy Gradient for Average Reward Non-Stationary RLcited by 0
- 2025Multi-agent Markov Entanglementcited by 0
- 2025Decision-Focused Bias Correction for Fluid Approximation4 Dec 2025
- 2025No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!16 Jun 2025
- 2025Multi-agent Markov Entanglement3 Jun 2025
- 2025Natural Policy Gradient for Average Reward Non-Stationary RL23 Apr 2025
- 2023Restarted Bayesian Online Change-point Detection for Non-Stationary Markov Decision Processes1 Apr 2023
- 2021Learning and Information in Stochastic Networks and Queues18 May 2021