Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models
Not on the map. Why?
Abstract (arXiv)
Multi-agent systems allow language models to solve tasks collaboratively by sharing complementary information. These systems typically communicate through text, while recent approaches also explore exchanging internal model states. However, sharing these states across architectures often requires learned translators or assumptions about model compatibility. We introduce SYNC (Symbol-Indexed Neural Communication), a word-indexed interface that connects heterogeneous models without fine-tuning or a learned translator. From descriptions only it can see, the sender selects words from a shared list and sends their indices for each object, without seeing the questions. The receiver writes the described facts into its hidden states using its own word directions, vectors fitted once from its activations. We test selective use by swapping one attribute between two objects and requiring correct answers about both changed and unchanged attributes before and after the swap, four answers in total. We choose an early write layer on four development receivers and then fix it. With three different senders and nine newer receivers from five families, four-answer success on new scenes reaches 72.0-98.3%, up to 96 percentage points above middle-layer writing, and the two largest receivers match plain text. A task-free probe predicted in advance which depths each new receiver can use (45 of 45 cases). Without retuning, messages listing every fact keep 89.6-100% success under new layouts, and sender messages reach 23.9-64.0% on a landmark task with multi-token symbols, below text but from 0% without a message. These results show that shared word indices and receiver-local directions can support selective fact use across model families without additional training.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 22 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
20 of 22 references.
References · 20
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2024The Platonic Representation Hypothesiscited by 382
- 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 235
- 2022Relative representations enable zero-shot latent space communicationcited by 191
- 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
- 2025Latent Collaboration in Multi-Agent Systemscited by 73
- 2024SelfIE: Self-Interpretation of Large Language Model Embeddingscited by 67
- 2025Cache-to-Cache: Direct Semantic Communication Between Large Language Modelscited by 61
8 more
- 2023Let Models Speak Ciphers: Multiagent Debate through Embeddingscited by 51
- 2025Transferring Linear Features Across Language Models With Model Stitchingcited by 21
- 2025Communicating Activations Between Language Model Agentscited by 16
- 2026XBridge: Entity-Grounded Latent Bridge for Heterogeneous LLM Communicationcited by 3
- 2026Dual-Cache Latent Space Communication between Heterogeneous Language Modelscited by 3
- 2026J-CoT: Chain-of-Thought in J-Spacecited by 2
- 2026Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Modelcited by 1
- 2026Beyond Token-Level Guidance: Inference-Time Alignment of Specialized LLMs via Cross-Family Representation Steeringcited by 1
Built on by
Not cited yet.