A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Management
Not on the map. Why?
Abstract (arXiv)
Multi-agent reinforcement learning (MARL) models multiple agents that interact and learn within a shared environment. This paradigm is applicable to various industrial scenarios such as autonomous driving, quantitative trading, and inventory management. However, applying MARL to these real-world scenarios is impeded by many challenges such as scaling up, complex agent interactions, and non-stationary dynamics. To incentivize the research of MARL on these challenges, we develop MABIM (Multi-Agent Benchmark for Inventory Management) which is a multi-echelon, multi-commodity inventory management simulator that can generate versatile tasks with these different challenging properties. Based on MABIM, we evaluate the performance of classic operations research (OR) methods and popular MARL algorithms on these challenging tasks to highlight their weaknesses and potential.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 26 of its 54 references that are in the map. First posted on arXiv 13 Jun 2023.
Builds on
26 of 54 references.
References · 26
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 721
- 2019The StarCraft Multi-Agent Challengecited by 597
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
- 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 485
- 2017Robust Adversarial Reinforcement Learningcited by 451
- 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 379
- 2017StarCraft II: A New Challenge for Reinforcement Learningcited by 274
- 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 263
- 2019Google Research Football: A Novel Reinforcement Learning Environmentcited by 260
- 2018Mean Field Multi-Agent Reinforcement Learningcited by 207
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 197
14 more
- 2020FACMAC: Factored Multi-Agent Centralised Policy Gradientscited by 178
- 2018A Survey and Critique of Multiagent Deep Reinforcement Learningcited by 177
- 2020Qlib: An AI-oriented Quantitative Investment Platformcited by 81
- 2020Towards Playing Full MOBA Games with Deep Reinforcement Learningcited by 78
- 2018RecoGym: A Reinforcement Learning Environment for the problem of Product Recommendation in Online Advertisingcited by 65
- 2018Generative Adversarial User Model for Reinforcement Learning Based Recommendation Systemcited by 64
- 2020Reinforcement Learning in Economics and Financecited by 58
- 2020Multi-agent Reinforcement Learning for Networked System Controlcited by 53
- 2020OR-Gym: A Reinforcement Learning Library for Operations Research Problemscited by 51
- 2021Collective Intelligence for Deep Learning: A Survey of Recent Developmentscited by 34
- 2018StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer Learningcited by 25
- 2018Discovering and Removing Exogenous State Variables and Rewards for Reinforcement Learningcited by 24
- 2022Multi-Agent Reinforcement Learning with Shared Resources for Inventory Managementcited by 5
- 2023Towards Generalizable Reinforcement Learning for Trade Executioncited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 3; 2026: 4.
10 papers.
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 50
- 2023Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reductioncited by 24
- 2024Agentic LLMs in the Supply Chain: Towards Autonomous Multi-Agent Consensus-Seekingcited by 16
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learningcited by 7
- 2024Knowing What Not to Do: Leverage Language Model Insights for Action Space Pruning in Multi-agent Reinforcement Learningcited by 3
- 2025Iterative Multi-Agent Reinforcement Learning: A Novel Approach Toward Real-World Multi-Echelon Inventory Optimizationcited by 1
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Reviewcited by 1
- 2026gym-invmgmt: An Open Benchmarking Framework for Inventory Management Methodscited by 1
- 2026SkillChain-Gym: A Benchmark for Reskilling-Aware Production-Inventory Control under Disruptionscited by 0
- 2026Who Bears the Burden? Learning Responsibility for Shared Constraints in Multi-Agent Reinforcement Learningcited by 0
- 2026Who Bears the Burden? Learning Responsibility for Shared Constraints in Multi-Agent Reinforcement Learning5 Oct 2026
- 2026SkillChain-Gym: A Benchmark for Reskilling-Aware Production-Inventory Control under Disruptions15 Jun 2026
- 2026gym-invmgmt: An Open Benchmarking Framework for Inventory Management Methods12 May 2026
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Review14 Jul 2025
- 2025Iterative Multi-Agent Reinforcement Learning: A Novel Approach Toward Real-World Multi-Echelon Inventory Optimization23 Mar 2025
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learning27 Feb 2025
- 2024Agentic LLMs in the Supply Chain: Towards Autonomous Multi-Agent Consensus-Seeking15 Nov 2024
- 2024Knowing What Not to Do: Leverage Language Model Insights for Action Space Pruning in Multi-agent Reinforcement Learning27 May 2024
- 2023Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction12 Oct 2023