Collaborative Information Dissemination with Graph-based Multi-Agent Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Efficient information dissemination is crucial for supporting critical operations across domains like disaster response, autonomous vehicles, and sensor networks. This paper introduces a Multi-Agent Reinforcement Learning (MARL) approach as a significant step forward in achieving more decentralized, efficient, and collaborative information dissemination. We propose a Partially Observable Stochastic Game (POSG) formulation for information dissemination empowering each agent to decide on message forwarding independently, based on the observation of their one-hop neighborhood. This constitutes a significant paradigm shift from heuristics currently employed in real-world broadcast protocols. Our novel approach harnesses Graph Convolutional Reinforcement Learning and Graph Attention Networks (GATs) with dynamic attention to capture essential network features. We propose two approaches, L-DyAN and HL-DyAN, which differ in terms of the information exchanged among agents. Our experimental results show that our trained policies outperform existing methods, including the state-of-the-art heuristic, in terms of network coverage as well as communication overhead on dynamic networks of varying density and behavior.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 25 Aug 2023.
Builds on
21 of 37 references.
References · 21
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 785
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
- 2015Deep Recurrent Q-Learning for Partially Observable MDPscited by 465
- 2016Learning Multiagent Communication with Backpropagationcited by 366
- 2020PettingZoo: Gym for Multi-Agent Reinforcement Learningcited by 220
- 2018TarMAC: Targeted Multi-Agent Communicationcited by 208
9 more
- 2018Learning Attentional Communication for Multi-Agent Cooperationcited by 175
- 2018Graph Convolutional Reinforcement Learningcited by 152
- 2021Tianshou: a Highly Modularized Deep Reinforcement Learning Librarycited by 143
- 2017Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Gamescited by 96
- 2021DeepCQ+: Robust and Scalable Routing with Multi-Agent Deep Reinforcement Learning for Highly Dynamic Networkscited by 6
- 2022Deep Reinforcement Learning for Multi-Agent Interactioncited by 3
- 2023DeepMPR: Enhancing Opportunistic Routing in Wireless Networks through Multi-Agent Deep Reinforcement Learningcited by 2
- 2023Learning to Sail Dynamic Networks: The MARLIN Reinforcement Learning Framework for Congestion Control in Tactical Environmentscited by 2
- 2023DeepADMR: A Deep Learning based Anomaly Detection for MANET Routingcited by 1
Built on by
Not cited yet.