Ready from Day 1: Population-Aware Coordination for Large-Scale Constrained Multi-Agent Systems
Not on the map. Why?
Abstract (arXiv)
In large-scale multi-agent systems with shared resource constraints, an upstream planner must iteratively evaluate candidate resource plans -- assessing feasibility, aggregate response, and marginal cost -- before committing to one. Lagrangian relaxation separates local decisions through a broadcast cost signal, but the planner still needs the cost-to-utilization response map to explore plan space, and this map depends on population composition that changes across planning cycles. We propose population-aware coordination interfaces: learned primal and dual maps, conditioned on compact population summaries, that the planner queries inside its iterative loop. The primal map predicts aggregate utilization under a proposed cost trajectory; the dual map predicts the cost trajectory for a target plan. By encoding response-relevant population structure, these maps remain reliable across evolving populations without per-cycle retraining, and support coordination of large populations from compact subsamples. We additionally cast Sim2Real transfer as a backtestable procedure, enabling evaluation before deployment. In a supply-chain capacity-control case study, population-aware interfaces reduce forecast error by 16--19% and capacity violations by 20--51% relative to population-unaware baselines under composition shift; 20K-agent cohorts support accurate coordination of 500K-agent populations; and simulator-trained primal maps achieve 11.1% MAPE on real observations versus 13--24% for baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
20 of 41 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2021Convex optimizationcited by 2,515
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2017Deep Setscited by 1,421
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 708
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 599
- 2019Differentiable Convex Optimization Layerscited by 465
- 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 319
8 more
- 2017Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuningcited by 297
- 2018Mean Field Multi-Agent Reinforcement Learningcited by 207
- 2022Do Differentiable Simulators Give Better Policy Gradients?cited by 89
- 2022Hindsight Learning for MDPs with Exogenous Inputscited by 26
- 2023An Analysis of Multi-Agent Reinforcement Learning for Decentralized Inventory Control Systemscited by 11
- 2024Neural Coordination and Capacity Control for Inventory Managementcited by 6
- 2023Learning an Inventory Control Policy with General Inventory Arrival Dynamicscited by 5
- 2024Consensus Planning with Primal, Dual, and Proximal Agentscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.