Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Latent communication in large language model (LLM)-based multi-agent systems (MAS) transmits continuous internal representations instead of text, but greater representational capacity does not establish that the receiver uses task-relevant information. End-task performance alone also cannot reveal whether an observed effect depends on message presence, content generated for the evaluated example, or information supplied by a separate agent. We introduce a causal audit that applies controlled message replacements at the boundary where the sender-produced representation enters the receiver. Four message settings support five measurements of encoded sender information, receiver sensitivity to message presence and identity, the task value of example-specific content, and the additional value supplied by a separate agent. We apply the audit to latent relay with Qwen3-4B and Qwen3-8B on GSM8K, ARC-C, and MATH-500. On GSM8K, the Qwen3-4B overall performance effect of -1.00 percentage point decomposes into a -6.17-point effect retained by an other-example message and a +5.17-point effect attributable to example-specific content; both component directions reverse at 8B. On MATH-500, the Qwen3-4B gain of 15.00 points comprises 8.33 points retained by an other-example message and 6.67 points attributable to example-specific content, while the 8B gain is dominated by the former component. Self-substitution comparisons further show that example-specific content and other-agent value are distinct. These results show that aggregate accuracy does not identify how a latent message affects the receiver and motivate controlled message comparisons as a standard evaluation for latent communication.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 14 of its 22 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
14 of 22 references.
Closest ancestors · 2
Same direction, newest first
- 2026Counterfactual Graph for Multi-Agent LLM Calibration28 May
- 2026When Less Latent Leads to Better Relay: Information-Preserving Compression for Latent Multi-Agent LLM Collaboration14 Apr
Other references · 12
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2023Let's Verify Step by Stepcited by 3,598
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2019On Variational Bounds of Mutual Informationcited by 550
- 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 328
- 2018Formal Limitations on the Measurement of Mutual Informationcited by 189
- 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 181
- 2019Understanding the Limitations of Variational Mutual Information Estimatorscited by 140
- 2019On the Pitfalls of Measuring Emergent Communicationcited by 66
- 2023Let Models Speak Ciphers: Multiagent Debate through Embeddingscited by 49
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMscited by 3
- 2026What You Can't See Is What You Learn: Slot-Selective Evidence Masking Favors Compositional Generalization in Shared-Genome Language-Model Societiescited by 1
- 2026Portable Semantics, Private Dialects: Reuse and Negative Transfer in Latent Communication Between Language-Model Cellscited by 1
- 2026Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognitioncited by 0
- 2026Social Circuits behind Multi-agent Echo Chamberscited by 0
- 2026Social Circuits behind Multi-agent Echo Chambers28 Sep 2026
- 2026Portable Semantics, Private Dialects: Reuse and Negative Transfer in Latent Communication Between Language-Model Cells10 Sep 2026
- 2026Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognition7 Sep 2026
- 2026What You Can't See Is What You Learn: Slot-Selective Evidence Masking Favors Compositional Generalization in Shared-Genome Language-Model Societies20 Aug 2026
- 2026When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs5 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems
- 2026Faithful, Not Corrective: Model Capability Governs Message-Format Effects in Multi-Hop Agent Relays
- 2025Enabling Agents to Communicate Entirely in Latent Space
- 2026Latent Communication Between Language Model Agents: Channels, Alignment, and the Limits of Text
- 2026Beyond the Transcript: Detecting Covert Co ordination in Latent Multi-Agent Communication
- 2026Beyond Final Accuracy: Auditing Communication in LLM Multi-Agent Systems
- 2025Latent Collaboration in Multi-Agent Systems
- 2026Prospective Interpretation Risk: Principled Communication Control Between LLMs