A Token/KV-Cache Communication Media Selection and Resource Allocation Strategy for Multi-Agent Collaboration
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The convergence of large language models (LLMs) with 6G networks is fostering a paradigm of autonomous multi-agent cooperation, which in turn is expected to substantially increase east-west traffic. Although latent-space interaction mechanisms can enable more efficient collaboration than symbolic natural-language (NL) exchanges, prior work often abstracts away the associated communication overhead under practical wireless constraints. In embodied multi-agent settings, heterogeneous interaction media incur disparate inference and transmission costs, thereby inducing an inherent end-to-end (E2E) latency trade-off. To address this, we propose a joint design that integrates communication-media selection with wireless resource allocation. Through analytical characterization and simulation-based evaluation, we show that neither token-based transmission nor key-value (KV) cache-based transmission is uniformly optimal across operating regimes, as performance depends critically on system parameters such as available computational resources and channel conditions. Accordingly, we formulate a joint optimization problem aimed at minimizing the E2E latency of multi-agent collaboration and develop a low-complexity joint media selection and resource allocation (JMSRA) algorithm. Numerical results further confirm that, by adaptively coordinating the interaction media and bandwidth allocation over heterogeneous links, the proposed scheme achieves markedly reduced E2E latency relative to conventional NL-only and KV-cache-only baselines, enabling efficient and robust multi-agent collaboration in future wireless networks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 18 of its 30 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
18 of 30 references.
Closest ancestors · 4
Same direction, newest first
- 2026Agent Primitives: Reusable Latent Building Blocks for Multi-Agent Systems3 Feb
- 2025Latent Collaboration in Multi-Agent Systems25 Nov
- 2025Enabling Agents to Communicate Entirely in Latent Space12 Nov
- 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems20 Feb
Other references · 14
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023A Survey of Large Language Modelscited by 2,576
- 2023FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPUcited by 575
- 2024QAQ: Quality Adaptive Quantization for LLM KV Cachecited by 66
- 2025Thought Communication in Multiagent Collaborationcited by 30
- 2024Overview of AI and Communication for 6G Network: Fundamentals, Challenges, and Future Research Opportunitiescited by 26
- 2024Compute Or Load KV Cache? Why Not Both?cited by 25
- 2026DualPath: Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inferencecited by 15
- 2025Q-KVComm: Efficient Multi-Agent Communication Via Adaptive KV Cache Compressioncited by 9
- 2024Towards Wireless Native Big AI Model: The Mission and Approach Differ From Large Language Modelcited by 7
- 2025Efficient LLM Inference over Heterogeneous Edge Networks with Speculative Decodingcited by 4
- 2025Distributed On-Device LLM Inference With Over-the-Air Computationcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs
- 2026Swarm Telepathy: Prefill-Free KV-Cache Transfer Across Families
- 2025KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems
- 2026Think Before You Speak: Enabling Training-Free Latent Communication Between Language Models
- 2026Agentic AI-Empowered Wireless Agent Networks With Semantic-Aware Collaboration via ILAC
- 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems
- 2026Receiver-Conditioned Latent Communication gives 94% CacheBack
- 2026Communication-Efficient Digital-Twin Coordination for Heterogeneous LLM Embodied Agents over Computing Power Networks