From Agents to Edges: Paired Optimization for Multi-Agent Collaboration
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Strong individual agents do not guarantee effective collaboration. Communication must align what one agent conveys with how another interprets and uses it. This dependency makes the communication edge a natural unit of optimization. We introduce Paired Automated Communication Optimization (PACO), which jointly optimizes the instructions at both ends of each edge and their shared communication convention in systems built on black-box language models. PACO keeps model weights, agent roles, and workflow topology fixed. A state-aware discounted bandit selects edges for refinement, while execution feedback guides paired revisions evaluated through staged end-to-end execution. The optimized instructions integrate into existing agent prompts without additional model calls at deployment. On a four-agent workflow evaluated across diverse multi-agent benchmarks, PACO consistently outperforms leading prompt-optimization and communication baselines. Configurations learned on HotpotQA retain their advantage in cross-dataset transfer without target-specific optimization. These results demonstrate that optimizing how agents communicate can substantially improve collaboration within an otherwise fixed system.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 21 of its 27 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
21 of 27 references.
Closest ancestors · 10
Same direction, newest first
- 2026What Should Agents Say? Action-state Communication for Efficient Multi-Agent Systems3 Jun
- 2026MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systems7 May
- 2026MASPOB: Bandit-Based Prompt Optimization for Multi-Agent Systems with Graph Neural Networks3 Mar
- 2025AgentAsk: Multi-Agent Systems Need to Ask8 Oct
- 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference8 Oct
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
- 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System10 Oct
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
Other references · 11
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 903
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 291
- 2026Agentic Kernel Optimization: Generating State-of-the-Art GPU Kernels Without Hand-Written CUDAcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperation
- 2026An Empirical Study of Multi-Agent Collaboration for Automated Research
- 2026Learning to Evolve: A Self-Improving Framework for Multi-Agent Systems via Textual Parameter Graph Optimization
- 2026Reinforced Collaboration in Multi-Agent Flow Networks
- 2026MASBench: Benchmarking LLM-based Multi-Agent Collaboration under Partial Observability
- 2025Adaptive Graph Pruning for Multi-Agent Communication
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaboration
- 2026Rethinking Multi-Agent Collaboration: When More Is Less