mlsanityData to 14 Oct 2026

Orchestrator: Active Inference for Multi-Agent Systems in Long-Horizon Tasks

arXiv 2509.05651 ↗First posted 6 Sep 2025cs.MA cs.AIcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Complex, non-linear tasks challenge LLM-enhanced multi-agent systems (MAS) due to partial observability and suboptimal coordination. We propose Orchestrator, a novel MAS framework that leverages attention-inspired self-emergent coordination and reflective benchmarking to optimize global task performance. Orchestrator introduces a monitoring mechanism to track agent-environment dynamics, using active inference benchmarks to optimize system behavior. By tracking agent-to-agent and agent-to-environment interaction, Orchestrator mitigates the effects of partial observability and enables agents to approximate global task solutions more efficiently. We evaluate the framework on a series of maze puzzles of increasing complexity, demonstrating its effectiveness in enhancing coordination and performance in dynamic, non-linear environments with long-horizon objectives.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 40 of its 56 references that are in the map. First posted on arXiv 6 Sep 2025.

Builds on

40 of 56 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Optimizing Sequential Multi-Step Tasks with Parallel LLM Agents11 Jul
  2. 2025Adaptive Graph Pruning for Multi-Agent Communication3 Jun
  3. 2025Multi-Agent Collaboration via Evolving Orchestration26 May
  4. 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision21 May
  5. 2025SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planning15 Mar
  6. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks12 Mar
  7. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System10 Oct
  8. 2024More Agents Is All You Need3 Feb
  9. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug

Other references · 31

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  6. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
  7. 2018Actor-Attention-Critic for Multi-Agent Reinforcement Learningcited by 261
  8. 2024AI Agents That Mattercited by 219
  9. 2019Multi-Agent Pathfinding: Definitions, Variants, and Benchmarkscited by 199
  10. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
  11. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
  12. 2017Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observabilitycited by 148
19 more
  1. 2025Teaching Language Models to Critique via Reinforcement Learningcited by 42
  2. 2025AlphaMaze: Enhancing Large Language Models' Spatial Intelligence via GRPOcited by 33
  3. 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environmentscited by 32
  4. 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Makingcited by 20
  5. 2023Memory Gym: Towards Endless Tasks to Benchmark Memory Capabilities of Agentscited by 16
  6. 2022Multi-Agent Coordination via Multi-Level Communicationcited by 14
  7. 2024HDFlow: Enhancing LLM Complex Problem-Solving with Hybrid Thinking and Dynamic Workflowscited by 13
  8. 2023On Implementing Autonomous Supply Chains: a Multi-Agent System Approachcited by 8
  9. 2024Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimizationcited by 8
  10. 2024Maximizing utility in multi-agent environments by anticipating the behavior of other learnerscited by 8
  11. 2025MazeEval: A Benchmark for Testing Sequential Decision-Making in Language Modelscited by 8
  12. 2024EVINCE: Optimizing Multi-LLM Dialogues Using Conditional Statistics and Information Theorycited by 6
  13. 2024Grounded Answers for Multi-agent Decision-making Problem through Generative World Modelcited by 6
  14. 2024Distributed maze exploration using multiple agents and optimal goal assignmentcited by 5
  15. 2024Factorised Active Inference for Strategic Multi-Agent Interactionscited by 4
  16. 2025Deep Active Inference Agents for Delayed and Long-Horizon Environmentscited by 4
  17. 2025Free Energy Risk Metrics for Systemically Safe AI: Gatekeeping Multi-Agent Studycited by 2
  18. 2025Cooperative Hybrid Multi-Agent Pathfinding Based on Shared Exploration Mapscited by 2
  19. 2024AMaze: An intuitive benchmark generator for fast prototyping of generalizable agentscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MAS-Orchestra: Understanding and Improving Multi-Agent Reasoning Through Holistic Orchestration and Controlled Benchmarks
  2. 2026Learning Latency-Aware Orchestration for Multi-Agent Systems
  3. 2026Learning Latency-Aware Orchestration for Multi-Agent Systems
  4. 2026Small Model as Master Orchestrator: Learning Unified Agent-Tool Orchestration with Parallel Subtask Decomposition
  5. 2026Multi-Agent Coordination Adaptation via Structure-Guided Orchestration
  6. 2026Recognize Your Orchestrator: An Entropy Dynamics Perspective for LLM Multi-Agent Systems
  7. 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence
  8. 2026Team of Thoughts: Efficient Test-time Scaling of Agentic Systems through Orchestrated Tool Calling