Pommerman: A Multi-Agent Playground
Not on the map. Why?
Abstract (arXiv)
We present Pommerman, a multi-agent environment based on the classic console game Bomberman. Pommerman consists of a set of scenarios, each having at least four players and containing both cooperative and competitive aspects. We believe that success in Pommerman will require a diverse set of tools and methods, including planning, opponent/teammate modeling, game theory, and communication, and consequently can serve well as a multi-agent benchmark. To date, we have already hosted one competition, and our next one will be featured in the NIPS 2018 competition track.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 4; 2022: 10; 2023: 6; 2024: 4; 2025: 3; 2026: 2.
30 papers.
Sort:
By area:
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
- 2022SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learningcited by 118
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 81
- 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learningcited by 63
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 47
- 2020Adversarial Soft Advantage Fitting: Imitation Learning without Policy Optimizationcited by 22
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordinationcited by 22
- 2022MARLlib: A Scalable and Efficient Multi-agent Reinforcement Learning Librarycited by 21
- 2021The Neural MMO Platform for Massively Multiagent Researchcited by 17
- 2023Games for Artificial Intelligence Research: A Review and Perspectivescited by 14
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 11
18 more
- 2022Efficient Exploration in Resource-Restricted Reinforcement Learningcited by 10
- 2025MEAL: A Benchmark for Continual Multi-Agent Reinforcement Learningcited by 8
- 2021Multi-Agent Advisor Q-Learningcited by 4
- 2022Self-Imitation Learning from Demonstrationscited by 4
- 2024Checkmating One, by Using Many: Combining Mixture of Experts with MCTS to Improve in Chesscited by 4
- 2024Multi-Agent Training for Pommerman: Curriculum Learning and Population-based Self-Play Approachcited by 3
- 2022Decision-making with Speculative Opponent Modelscited by 2
- 2021Playing Against the Board: Rolling Horizon Evolutionary Algorithms Against Pandemiccited by 1
- 2022Developing a Successful Bomberman Agentcited by 1
- 2022Value-based CTDE Methods in Symmetric Two-team Markov Game: from Cooperation to Team Competitioncited by 1
- 2021A Fast Evolutionary adaptation for MCTS in Pommermancited by 0
- 2023Learning from Multiple Independent Advisors in Multi-agent Reinforcement Learningcited by 0
- 2023Know your Enemy: Investigating Monte-Carlo Tree Search with Opponent Models in Pommermancited by 0
- 2023The NeurIPS 2022 Neural MMO Challenge: A Massively Multiagent Competition with Specialization and Tradecited by 0
- 2024Effective Reward Specification in Deep Reinforcement Learningcited by 0
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Reviewcited by 0
- 2025StarCraft+: Benchmarking Multi-agent Algorithms in Adversary Paradigmcited by 0
- 2026Reinforcement Learning: From Algorithms To Foundation Modelscited by 0
- 2026Reinforcement Learning: From Algorithms To Foundation Models20 Jul 2026
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2025StarCraft+: Benchmarking Multi-agent Algorithms in Adversary Paradigm18 Dec 2025
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Review14 Jul 2025
- 2025MEAL: A Benchmark for Continual Multi-Agent Reinforcement Learning17 Jun 2025
- 2024Effective Reward Specification in Deep Reinforcement Learning10 Dec 2024
- 2024Multi-Agent Training for Pommerman: Curriculum Learning and Population-based Self-Play Approach30 Jun 2024
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teams19 Mar 2024
- 2024Checkmating One, by Using Many: Combining Mixture of Experts with MCTS to Improve in Chess30 Jan 2024
- 2023The NeurIPS 2022 Neural MMO Challenge: A Massively Multiagent Competition with Specialization and Trade7 Nov 2023
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots19 Oct 2023
- 2023Building Cooperative Embodied Agents Modularly with Large Language Models5 Jul 2023
18 more
- 2023Know your Enemy: Investigating Monte-Carlo Tree Search with Opponent Models in Pommerman22 May 2023
- 2023Games for Artificial Intelligence Research: A Review and Perspectives26 Apr 2023
- 2023Learning from Multiple Independent Advisors in Multi-agent Reinforcement Learning26 Jan 2023
- 2022SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learning14 Dec 2022
- 2022Efficient Exploration in Resource-Restricted Reinforcement Learning14 Dec 2022
- 2022Decision-making with Speculative Opponent Models22 Nov 2022
- 2022Value-based CTDE Methods in Symmetric Two-team Markov Game: from Cooperation to Team Competition21 Nov 2022
- 2022MARLlib: A Scalable and Efficient Multi-agent Reinforcement Learning Library11 Oct 2022
- 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learning7 Jul 2022
- 2022Distributed Reinforcement Learning for Robot Teams: A Review7 Apr 2022
- 2022Self-Imitation Learning from Demonstrations21 Mar 2022
- 2022Developing a Successful Bomberman Agent17 Mar 2022
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordination28 Jan 2022
- 2021A Fast Evolutionary adaptation for MCTS in Pommerman26 Nov 2021
- 2021Multi-Agent Advisor Q-Learning26 Oct 2021
- 2021The Neural MMO Platform for Massively Multiagent Research14 Oct 2021
- 2021Playing Against the Board: Rolling Horizon Evolutionary Algorithms Against Pandemic28 Mar 2021
- 2020Adversarial Soft Advantage Fitting: Imitation Learning without Policy Optimization23 Jun 2020
- 2026Reinforcement Learning: From Algorithms To Foundation Models20 Jul 2026
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
- 2022SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learningcited by 118
- 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learningcited by 63
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordinationcited by 22
- 2022MARLlib: A Scalable and Efficient Multi-agent Reinforcement Learning Librarycited by 21
- 2021The Neural MMO Platform for Massively Multiagent Researchcited by 17
- 2023Games for Artificial Intelligence Research: A Review and Perspectivescited by 14
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 11
- 2022Efficient Exploration in Resource-Restricted Reinforcement Learningcited by 10
- 2025MEAL: A Benchmark for Continual Multi-Agent Reinforcement Learningcited by 8
- 2021Multi-Agent Advisor Q-Learningcited by 4
- 2024Multi-Agent Training for Pommerman: Curriculum Learning and Population-based Self-Play Approachcited by 3
12 most cited of 23 All 23 (JSON)
- 2025StarCraft+: Benchmarking Multi-agent Algorithms in Adversary Paradigm18 Dec 2025
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Review14 Jul 2025
- 2025MEAL: A Benchmark for Continual Multi-Agent Reinforcement Learning17 Jun 2025
- 2024Effective Reward Specification in Deep Reinforcement Learning10 Dec 2024
- 2024Multi-Agent Training for Pommerman: Curriculum Learning and Population-based Self-Play Approach30 Jun 2024
- 2023The NeurIPS 2022 Neural MMO Challenge: A Massively Multiagent Competition with Specialization and Trade7 Nov 2023
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots19 Oct 2023
- 2023Know your Enemy: Investigating Monte-Carlo Tree Search with Opponent Models in Pommerman22 May 2023
- 2023Games for Artificial Intelligence Research: A Review and Perspectives26 Apr 2023
- 2023Learning from Multiple Independent Advisors in Multi-agent Reinforcement Learning26 Jan 2023
- 2022SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learning14 Dec 2022
- 2022Efficient Exploration in Resource-Restricted Reinforcement Learning14 Dec 2022
12 newest of 23 All 23 (JSON)