mlsanityData to 14 Oct 2026

Multi-Agent Coordination Adaptation via Structure-Guided Orchestration

arXiv 2605.25746 ↗First posted 25 May 2026cs.MA cs.AIcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

As large language model (LLM)-based multi-agent systems scale to handle increasingly complex tasks, balancing structural stability and dynamic adaptability becomes increasingly challenging. Existing systems typically adopt either structure-centric methods, committing to structures determined upfront that limit fine-grained control, or orchestration-centric methods, adapting decisions dynamically while leaving coordination structure implicit and unstable. To address this challenge, we revisit multi-agent coordination from a probabilistic perspective, casting it as posterior inference over the joint distribution of structure and orchestration. We introduce MACA, an automated coordination framework that learns a task- and budget-conditioned structural prior over agent participation and interactions. This prior guides a policy-based orchestration as an approximation to posterior inference, enabling efficient solutions with fine-grained control. Across benchmarks, MACA outperforms adaptive multi-agent baselines by an average of 8.42% while using 43.19% fewer tokens. Further investigation reveals that joint adaptation of structure and orchestration suppresses redundant interactions, converging coordination toward task-effective execution.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 34 of its 62 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

34 of 62 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference8 Oct
  2. 2025AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaboration23 Sep
  3. 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaboration5 Sep
  4. 2025AgentMisalignment: Measuring the Propensity for Misaligned Behaviour in LLM-Based Agents4 Jun
  5. 2025Creativity in LLM-based Multi-Agent Systems: A Survey27 May
  6. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  7. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space8 Oct
  8. 2024MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPs19 Aug
  9. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms20 Jun
  10. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
  11. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb
  12. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects7 Jan
5 more
  1. 2024LLM Harmony: Multi-Agent Communication for Problem Solving2 Jan
  2. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
  3. 2023ExpeL: LLM Agents Are Experiential Learners20 Aug
  4. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun
  5. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 17

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  4. 2021Program Synthesis with Large Language Modelscited by 3,637
  5. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  6. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  7. 2017Deep Image Priorcited by 1,098
  8. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  9. 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 482
  10. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
  11. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
  12. 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 60
5 more
  1. 2023GSLB: The Graph Structure Learning Benchmarkcited by 50
  2. 2020Making Sense of Reinforcement Learning and Probabilistic Inferencecited by 30
  3. 2025Large Language Model-based Data Science Agent: A Surveycited by 23
  4. 2020FP-NAS: Fast Probabilistic Neural Architecture Searchcited by 11
  5. 2025When Should We Orchestrate Multiple Agents?cited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence
  2. 2025Orchestrator: Active Inference for Multi-Agent Systems in Long-Horizon Tasks
  3. 2025Multi-agent Coordination via Flow Matching
  4. 2025Multi-Agent Collaboration via Evolving Orchestration
  5. 2026Degrees of Freedom in Multi-Agent Coordination: Between Centralized and Decentralized Regimes
  6. 2026Learning Latency-Aware Orchestration for Multi-Agent Systems
  7. 2026Learning Latency-Aware Orchestration for Multi-Agent Systems
  8. 2025Dynamic Strategy Adaptation in Multi-Agent Environments with Large Language Models