mlsanityData to 7 Oct 2026

Multi-Agent Reinforcement Learning with Shared Resources for Inventory Management

arXiv 2212.07684 ↗First posted 15 Dec 2022cs.AI cs.LG math.OCcited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper, we consider the inventory management (IM) problem where we need to make replenishment decisions for a large number of stock keeping units (SKUs) to balance their supply and demand. In our setting, the constraint on the shared resources (such as the inventory capacity) couples the otherwise independent control for each SKU. We formulate the problem with this structure as Shared-Resource Stochastic Game (SRSG)and propose an efficient algorithm called Context-aware Decentralized PPO (CD-PPO). Through extensive experiments, we demonstrate that CD-PPO can accelerate the learning procedure compared with standard MARL algorithms.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 36 of its 83 references that are in the map. First posted on arXiv 15 Dec 2022.

Builds on

36 of 83 references.

References · 36

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  3. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  4. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  5. 2017Counterfactual Multi-Agent Policy Gradientscited by 733
  6. 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 697
  7. 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
  8. 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 372
  9. 2016Learning Multiagent Communication with Backpropagationcited by 355
  10. 2020Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?cited by 281
  11. 2020Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative Taskscited by 207
  12. 2017Multi-agent Reinforcement Learning in Sequential Social Dilemmascited by 206
24 more
  1. 2018Mean Field Multi-Agent Reinforcement Learningcited by 202
  2. 2020Weighted QMIX: Expanding Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 197
  3. 2018Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agentscited by 189
  4. 2019MAVEN: Multi-Agent Variational Explorationcited by 181
  5. 2020FACMAC: Factored Multi-Agent Centralised Policy Gradientscited by 178
  6. 2020ROMA: Multi-Agent Reinforcement Learning with Emergent Rolescited by 135
  7. 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 104
  8. 2017Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Gamescited by 93
  9. 2019Learning Nearly Decomposable Value Functions Via Communication Minimizationcited by 85
  10. 2019Shapley Q-value: A Local Reward Approach to Solve Global Reward Gamescited by 71
  11. 2019Model-Free Mean-Field Reinforcement Learning: Mean-Field MDP and Mean-Field Q-Learningcited by 56
  12. 2020Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction Statescited by 55
  13. 2021Contrasting Centralized and Decentralized Critics in Multi-Agent Reinforcement Learningcited by 54
  14. 2020OR-Gym: A Reinforcement Learning Library for Operations Research Problemscited by 50
  15. 2018Actor-Critic Policy Optimization in Partially Observable Multiagent Environmentscited by 35
  16. 2016Applying Deep Learning to the Newsvendor Problemcited by 24
  17. 2021Model-based Multi-agent Policy Optimization with Adaptive Opponent-wise Rolloutscited by 24
  18. 2019Multi-Agent Reinforcement Learning with Multi-Step Generative Modelscited by 18
  19. 2018Learning to Share and Hide Intentions using Information Regularizationcited by 13
  20. 2020Reinforcement Learning for Multi-Product Multi-Node Inventory Management in Supply Chainscited by 13
  21. 2017Fully Decentralized Policies for Multi-Agent Systems: An Information Theoretic Approachcited by 5
  22. 2019Actor-Critic Algorithms for Constrained Multi-agent Reinforcement Learningcited by 5
  23. 2017A Deep Q-Network for the Beer Game: A Deep Reinforcement Learning algorithm to Solve Inventory Optimization Problemscited by 4
  24. 2014Weakly Coupled Dynamic Program: Information and Lagrangian Relaxationscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 0; 2025: 1; 2026: 1.

5 papers.

  1. 2023Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reductioncited by 24
  2. 2023Pre-Trained Large Language Models for Industrial Controlcited by 15
  3. 2023A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Managementcited by 9
  4. 2025CORD: Generalizable Cooperation via Role Diversitycited by 1
  5. 2026EventCast: Hybrid Demand Forecasting in E-Commerce with LLM-Based Event Knowledgecited by 1