SEA: A Spatially Explicit Architecture for Multi-Agent Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Spatial information is essential in various fields. How to explicitly model according to the spatial location of agents is also very important for the multi-agent problem, especially when the number of agents is changing and the scale is enormous. Inspired by the point cloud task in computer vision, we propose a spatial information extraction structure for multi-agent reinforcement learning in this paper. Agents can effectively share the neighborhood and global information through a spatially encoder-decoder structure. Our method follows the centralized training with decentralized execution (CTDE) paradigm. In addition, our structure can be applied to various existing mainstream reinforcement learning algorithms with minor modifications and can deal with the problem with a variable number of agents. The experiments in several multi-agent scenarios show that the existing methods can get convincing results by adding our spatially explicit architecture.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 25 Apr 2023.
Builds on
17 of 27 references.
References · 17
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 708
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 503
- 2016Learning Multiagent Communication with Backpropagationcited by 366
- 2016Safe, Multi-Agent, Reinforcement Learning for Autonomous Drivingcited by 311
- 2017A Unified Game-Theoretic Approach to Multiagent Reinforcement Learningcited by 268
- 2018Mean Field Multi-Agent Reinforcement Learningcited by 207
5 more
- 2019Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Controlcited by 164
- 2017MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective Intelligencecited by 71
- 2021HAVEN: Hierarchical Cooperative Multi-Agent Reinforcement Learning with Dual Coordination Mechanismcited by 19
- 2019Neighborhood Cognition Consistent Multi-Agent Reinforcement Learningcited by 17
- 2022Mingling Foresight with Imagination: Model-Based Cooperative Multi-Agent Reinforcement Learningcited by 6
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.