mlsanityData to 14 Oct 2026

StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systems

arXiv 2608.13317 ↗First posted 13 Aug 2026cs.AIcited by 5

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large language model based multi-agent systems usually communicate in text, i.e., using discrete tokens. However, text introduces a discrete bottleneck. Converting the sender's continuous hidden states into discrete tokens discards information that token identities alone cannot capture. Recent work proposes latent communication as an alternative, where agents transmit hidden representations directly without converting them to text. However, existing latent methods either inject working memory layer by layer across the transformers, or require trained projectors that limit portability. We propose StateBridge, a training-free latent communication approach that aligns the sender's final-layer hidden states to the receiver's input space via a closed-form orthogonal transformation. Lightweight norm calibration and vocabulary anchoring ensure compatibility with the pretrained input distribution. The aligned states are prepended to the input of the receiver agent as a continuous prefix. We evaluate StateBridge on math reasoning, code generation, and question answering with four models from two families. StateBridge achieves the best or tied-best score on 22 out of 26 model-task pairs, consistently outperforming the strongest baseline.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 37 of its 41 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

37 of 41 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Latent Collaboration in Multi-Agent Systems25 Nov
  2. 2025Enabling Agents to Communicate Entirely in Latent Space12 Nov
  3. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
  4. 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems20 Feb
  5. 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems16 Feb
  6. 2025SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning7 Feb
  7. 2024LLM-based Multi-Agent Systems: Techniques and Business Perspectives21 Nov
  8. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
  9. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System10 Oct
  10. 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
  11. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
  12. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
1 more
  1. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 24

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  5. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  8. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  9. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  10. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  11. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  12. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
12 more
  1. 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
  2. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 190
  3. 2024Large Language Model-Brained GUI Agents: A Surveycited by 162
  4. 2024MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolutioncited by 134
  5. 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 96
  6. 2025Cache-to-Cache: Direct Semantic Communication Between Large Language Modelscited by 61
  7. 2023Let Models Speak Ciphers: Multiagent Debate through Embeddingscited by 51
  8. 2024ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoningcited by 31
  9. 2025Thought Communication in Multiagent Collaborationcited by 30
  10. 2025Talk to Right Specialists: Iterative Routing in Multi-agent Systems for Question Answeringcited by 6
  11. 2025Predicting Multi-Agent Specialization via Task Parallelizabilitycited by 5
  12. 2025Optimal Transport Depth Up-Scalingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems
  2. 2026Latent Communication Between Language Model Agents: Channels, Alignment, and the Limits of Text
  3. 2026LatCom: Cross-Agent Latent Compression for Efficient Multi-Agent Collaboration
  4. 2026Think Before You Speak: Enabling Training-Free Latent Communication Between Language Models
  5. 2026XBridge: Entity-Grounded Latent Bridge for Heterogeneous LLM Communication
  6. 2025Collab: Controlled Decoding using Mixture of Agents for LLM Alignment
  7. 2026Learning to Communicate: Toward End-to-End Optimization of Multi-Agent Language Systems
  8. 2024LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaboration