Emergence, Not Bandwidth: Physical Coupling and the Limits of Learned Multi-Agent Communication
Not on the map. Why?
Abstract (arXiv)
Rate-limited multi-agent teams raise three questions the emergent-communication literature has answered only empirically: what an optimal message should encode, what compression costs over a horizon, and when a learned protocol is unique enough for a teammate to read. We answer them for rate-limited Dec-POMDPs, then measure how far reinforcement learning falls short of the optimum. Our theorems fix what is achievable independently of any learner, so a gap between an engineered and a learned sender at the same bit budget is an optimization fact, not an information-theoretic one. We instantiate this on three MuJoCo arenas spanning zero, partial and rigid physical coupling, charging every condition exactly 2 bits per decision, and create the discriminating regime by closing a physical side channel within one arena, holding bodies, task and reward fixed. Communication value is governed by coupling: under rigid coupling through a shared object, no channel beats silence (+0.001 +/- 0.001, p = 0.982, n = 25), since proprioception already carries that information; without coupling, every condition solves the task; under partial coupling, the engineered 2-bit sender reaches an interquartile mean of 1.000 but the learned one reaches 0.482, indistinguishable from silence (p = 0.400, n = 25). With a shared alphabet, bandwidth cannot explain the gap. Warm-starting from an engineered receiver localizes the failure: the same channel reaches 0.857 versus 0.562 cold-started (p < 0.001), so it is neither representational nor one of maintenance; reinforcement learning fails to discover the protocol. Cross-play shows learned protocols are individually meaningful but mutually unintelligible: self-play 0.980 collapses to 0.144 across seeds, and our best constructed alignment leaves at least 77% of that gap. All headline results use 25 seeds per arena and seven published baselines at matched rate.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 18 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
15 of 18 references.
References · 15
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 807
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
- 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
- 2019On the Pitfalls of Measuring Emergent Communicationcited by 71
- 2019Learning Efficient Multi-agent Communication: An Information Bottleneck Approachcited by 61
- 2019Anti-efficient encoding in emergent communicationcited by 59
- 2024Limits to scalable evaluation at the frontier: LLM as Judge won't beat twice the datacited by 51
- 2019Biases for Emergent Communication in Multi-agent Reinforcement Learningcited by 48
- 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
- 2022An Analysis of Discretization Methods for Communication Learning with Multi-Agent Reinforcement Learningcited by 6
3 more
- 2025Communicating Plans, Not Percepts: Scalable Multi-Agent Coordination with Embodied World Modelscited by 3
- 2026Bandwidth-Efficient Multi-Agent Communication through Information Bottleneck and Vector Quantizationcited by 2
- 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Generalization Bounds of Emergent Communications for Agentic AI Networking
- 2026MUTE: Return-Preserving Communication Unlearning for Efficient Multi-Agent Coordination
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs
- 2026Dynamic Coalition Formation and Communication Pricing in Skill-Based Agentic AI Systems
- 2024Signaling and Social Learning in Swarms of Robots
- 2022Towards Human-Agent Communication via the Information Bottleneck Principle
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints
- 2026The Informational Cost of Agency: A Bounded Measure of Interaction Efficiency for Deployed Reinforcement Learning