mlsanityData to 7 Oct 2026

Good Agentic Friends Do Not Just Give Verbal Advice: They Can Update Your Weights

arXiv 2605.13839 ↗First posted 13 May 2026cs.CLcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Multi-agent LLM systems usually collaborate by exchanging natural-language messages. This interface is simple and interpretable, but it forces each sender's intermediate computation to be serialized into tokens and then reprocessed by the receiver, thereby increasing the generated-token cost, prefill overhead, and KV-cache memory. We study an alternative communication interface: instead of appending a sender's message to the receiver's context, compile the sender's hidden states into a transient, receiver-specific weight perturbation. We introduce TFlow (Thought Flow), a weight-space communication framework for a known and fixed receiver architecture. For each query, frozen role-prompted sender agents process the input, and a learned parameter generator maps their internal activations into low-rank LoRA perturbations targeting the receiver's modules. These perturbations are fused and applied only during the receiver's generation, enabling instance-level adaptation without permanently changing the model or enlarging the receiver's text context. With three Qwen3-4B agents, TFlow improves over a standalone receiver by up to 8.5 accuracy points across five benchmarks while reducing processed tokens by up to 32.69%. Compared with a text-based three-agent baseline, it reduces total processed tokens by up to 83.27% and the wall-clock inference time by up to 4.6×, while maintaining competitive accuracy on four of five benchmarks. These results suggest that transient low-rank weight perturbations can serve as an executable communication medium for efficient multi-agent LLM collaboration.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 53 of its 57 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

53 of 57 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Agent Primitives: Reusable Latent Building Blocks for Multi-Agent Systems3 Feb
  2. 2025Latent Collaboration in Multi-Agent Systems25 Nov
  3. 2025Enabling Agents to Communicate Entirely in Latent Space12 Nov
  4. 2025Augmenting Multi-Agent Communication with State Delta Trajectory24 Jun
  5. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  6. 2024More Agents Is All You Need3 Feb
  7. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
  8. 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
  9. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  10. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  11. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 42

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  9. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  10. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  11. 2021Program Synthesis with Large Language Modelscited by 3,509
  12. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
30 more
  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  3. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  4. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  5. 2022Editing Models with Task Arithmeticcited by 1,076
  6. 2016HyperNetworkscited by 1,003
  7. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  8. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  9. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
  10. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
  11. 2021Merging Models with Fisher-Weighted Averagingcited by 613
  12. 2022Efficiently Scaling Transformer Inferencecited by 529
  13. 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 359
  14. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  15. 2021Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworkscited by 278
  16. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 247
  17. 2024Are We Done with MMLU?cited by 178
  18. 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 115
  19. 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
  20. 2023Deep Model Fusion: A Surveycited by 89
  21. 2023Let Models Speak Ciphers: Multiagent Debate through Embeddingscited by 49
  22. 2022HyperTuning: Toward Adapting Large Language Models without Back-propagationcited by 45
  23. 2024LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Taskscited by 39
  24. 2024Neural Network Diffusioncited by 39
  25. 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 36
  26. 2025Thought Communication in Multiagent Collaborationcited by 28
  27. 2025Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weightscited by 18
  28. 2024Conditional LoRA Parameter Generationcited by 16
  29. 2026W2T: LoRA Weights Already Know What They Can Docited by 4
  30. 2026HY-WU (Part I): An Extensible Functional Neural Memory Framework and An Instantiation in Text-Guided Image Editingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems
  2. 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems
  3. 2026QueenBee Planner: Skill-Evolving Communication Topologies for Token-Efficient LLM Multi-Agent Systems
  4. 2023Adapting LLM Agents with Universal Feedback in Communication
  5. 2025AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration
  6. 2026Graph-of-Agents: A Graph-based Framework for Multi-Agent LLM Collaboration
  7. 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
  8. 2026Latent Cache Flow: Model-to-Model Communication Without Text