Good Agentic Friends Do Not Just Give Verbal Advice: They Can Update Your Weights
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Multi-agent LLM systems usually collaborate by exchanging natural-language messages. This interface is simple and interpretable, but it forces each sender's intermediate computation to be serialized into tokens and then reprocessed by the receiver, thereby increasing the generated-token cost, prefill overhead, and KV-cache memory. We study an alternative communication interface: instead of appending a sender's message to the receiver's context, compile the sender's hidden states into a transient, receiver-specific weight perturbation. We introduce TFlow (Thought Flow), a weight-space communication framework for a known and fixed receiver architecture. For each query, frozen role-prompted sender agents process the input, and a learned parameter generator maps their internal activations into low-rank LoRA perturbations targeting the receiver's modules. These perturbations are fused and applied only during the receiver's generation, enabling instance-level adaptation without permanently changing the model or enlarging the receiver's text context. With three Qwen3-4B agents, TFlow improves over a standalone receiver by up to 8.5 accuracy points across five benchmarks while reducing processed tokens by up to 32.69%. Compared with a text-based three-agent baseline, it reduces total processed tokens by up to 83.27% and the wall-clock inference time by up to 4.6×, while maintaining competitive accuracy on four of five benchmarks. These results suggest that transient low-rank weight perturbations can serve as an executable communication medium for efficient multi-agent LLM collaboration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 53 of its 57 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
53 of 57 references.
Closest ancestors · 11
Same direction, newest first
- 2026Agent Primitives: Reusable Latent Building Blocks for Multi-Agent Systems3 Feb
- 2025Latent Collaboration in Multi-Agent Systems25 Nov
- 2025Enabling Agents to Communicate Entirely in Latent Space12 Nov
- 2025Augmenting Multi-Agent Communication with State Delta Trajectory24 Jun
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2024More Agents Is All You Need3 Feb
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 42
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
30 more
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2022Editing Models with Task Arithmeticcited by 1,076
- 2016HyperNetworkscited by 1,003
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2021Merging Models with Fisher-Weighted Averagingcited by 613
- 2022Efficiently Scaling Transformer Inferencecited by 529
- 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 359
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2021Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworkscited by 278
- 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 247
- 2024Are We Done with MMLU?cited by 178
- 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 115
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
- 2023Deep Model Fusion: A Surveycited by 89
- 2023Let Models Speak Ciphers: Multiagent Debate through Embeddingscited by 49
- 2022HyperTuning: Toward Adapting Large Language Models without Back-propagationcited by 45
- 2024LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Taskscited by 39
- 2024Neural Network Diffusioncited by 39
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 36
- 2025Thought Communication in Multiagent Collaborationcited by 28
- 2025Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weightscited by 18
- 2024Conditional LoRA Parameter Generationcited by 16
- 2026W2T: LoRA Weights Already Know What They Can Docited by 4
- 2026HY-WU (Part I): An Extensible Functional Neural Memory Framework and An Instantiation in Text-Guided Image Editingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems
- 2026QueenBee Planner: Skill-Evolving Communication Topologies for Token-Efficient LLM Multi-Agent Systems
- 2023Adapting LLM Agents with Universal Feedback in Communication
- 2025AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration
- 2026Graph-of-Agents: A Graph-based Framework for Multi-Agent LLM Collaboration
- 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
- 2026Latent Cache Flow: Model-to-Model Communication Without Text