mlsanityData to 14 Oct 2026

Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints

arXiv 2605.21085 ↗First posted 20 May 2026cs.MA cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Communication enables coordination in multi-agent reinforcement learning (MARL), but many real-world applications, e.g., search-and-rescue with drone swarms, operate under severe bandwidth constraints. Many communication architectures still expose a coupled bottleneck in which a shared latent representation is used for both policy execution and inter-agent communication. Consequently, reducing message size directly limits the policy's latent space, often leading to significant performance degradation. We address this with two contributions. First, we introduce β, a normalised per-agent bandwidth budget that unifies sparsity, rounds, and message dimension into a single comparable constraint. Second, we provide SLIM, a minimal architecture that decouples the communication pathway from the policy's latent representation, allowing us to isolate the effect of bandwidth from the effect of policy capacity while benefiting from in-step communication. We evaluate our method on several partially-observable MARL benchmarks, where communication is essential. Our approach achieves state-of-the-art performance and exhibits scalability and robustness under limited communication, with only marginal degradation as bandwidth is reduced.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

30 of 46 references.

References · 30

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  3. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  4. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  5. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
  6. 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
  7. 2017Counterfactual Multi-Agent Policy Gradientscited by 751
  8. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
  9. 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 485
  10. 2015Neural Module Networkscited by 376
  11. 2016Learning Multiagent Communication with Backpropagationcited by 366
  12. 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 263
18 more
  1. 2018TarMAC: Targeted Multi-Agent Communicationcited by 208
  2. 2021Trust Region Policy Optimisation in Multi-Agent Reinforcement Learningcited by 186
  3. 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 185
  4. 2018Learning Attentional Communication for Multi-Agent Cooperationcited by 175
  5. 2018Graph Convolutional Reinforcement Learningcited by 152
  6. 2018Learning when to Communicate at Scale in Multiagent Cooperative and Competitive Taskscited by 121
  7. 2019Learning to Schedule Communication in Multi-agent Reinforcement Learningcited by 93
  8. 2019Learning Nearly Decomposable Value Functions Via Communication Minimizationcited by 86
  9. 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learningcited by 68
  10. 2019Learning Efficient Multi-agent Communication: An Information Bottleneck Approachcited by 61
  11. 2020Deep Implicit Coordination Graphs for Multi-agent Reinforcement Learningcited by 60
  12. 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 58
  13. 2020Learning Individually Inferred Communication for Multi-Agent Cooperationcited by 55
  14. 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 48
  15. 2019Efficient Communication in Multi-Agent Reinforcement Learning via Variance Based Controlcited by 46
  16. 2019Learning Agent Communication under Limited Bandwidth by Message Pruningcited by 31
  17. 2023Context-aware Communication for Multi-agent Reinforcement Learningcited by 13
  18. 2023Dynamic Size Message Scheduling for Multi-Agent Communication under Limited Bandwidthcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Robust and Efficient Communication in Multi-Agent Reinforcement Learning
  2. 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learning
  3. 2025Bandwidth-constrained Variational Message Encoding for Cooperative Multi-agent Reinforcement Learning
  4. 2026Bandwidth-Efficient Multi-Agent Communication through Information Bottleneck and Vector Quantization
  5. 2026SCALE-COMM: Shared, Contrastively-Aligned Latent Embeddings for MARL Communication ↗
  6. 2025Multi-Agent Reinforcement Learning with Communication-Constrained Priors
  7. 2026Robust and Efficient Communication for Multi-Agent Learning
  8. 2026MUTE: Return-Preserving Communication Unlearning for Efficient Multi-Agent Coordination