Tacit Learning with Adaptive Information Selection for Cooperative Multi-Agent Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In multi-agent reinforcement learning (MARL), the centralized training with decentralized execution (CTDE) framework has gained widespread adoption due to its strong performance. However, the further development of CTDE faces two key challenges. First, agents struggle to autonomously assess the relevance of input information for cooperative tasks, impairing their decision-making abilities. Second, in communication-limited scenarios with partial observability, agents are unable to access global information, restricting their ability to collaborate effectively from a global perspective. To address these challenges, we introduce a novel cooperative MARL framework based on information selection and tacit learning. In this framework, agents gradually develop implicit coordination during training, enabling them to infer the cooperative behavior of others in a discrete space without communication, relying solely on local information. Moreover, we integrate gating and selection mechanisms, allowing agents to adaptively filter information based on environmental changes, thereby enhancing their decision-making capabilities. Experiments on popular MARL benchmarks show that our framework can be seamlessly integrated with state-of-the-art algorithms, leading to significant performance improvements.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 45 references that are in the map. First posted on arXiv 20 Dec 2024.
Builds on
29 of 45 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 697
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
- 2019The StarCraft Multi-Agent Challengecited by 589
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 372
- 2021Pay Attention to MLPscited by 367
17 more
- 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
- 2020QPLEX: Duplex Dueling Multi-Agent Q-Learningcited by 267
- 2019Google Research Football: A Novel Reinforcement Learning Environmentcited by 257
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 225
- 2018Learning Attentional Communication for Multi-Agent Cooperationcited by 170
- 2020SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Drivingcited by 121
- 2022SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learningcited by 118
- 2017Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Gamescited by 93
- 2019Learning Nearly Decomposable Value Functions Via Communication Minimizationcited by 85
- 2021Rethinking the Implementation Tricks and Monotonicity Constraint in Cooperative Multi-Agent Reinforcement Learningcited by 68
- 2020Learning Individually Inferred Communication for Multi-Agent Cooperationcited by 55
- 2021Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networkscited by 52
- 2018Decentralised Learning in Systems with Many, Many Strategic Agentscited by 19
- 2022More Centralized Training, Still Decentralized Execution: Multi-Agent Conditional Policy Factorizationcited by 19
- 2023Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?cited by 18
- 2018Social Influence as Intrinsic Motivation for Multi-Agent Deep Reinforcement Learningcited by 13
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
Built on by
Not cited yet.