Autonomous Repair for Multi-Agent Systems via Monte-Carlo Tree Search
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Multi-agent systems (MAS) are increasingly deployed to solve complex tasks. In case of incorrect or unsatisfactory outputs, users have to manually locate agent mistakes by inspecting agent trajectories (i.e., em failure attribution) and provide feedback to refine the outputs (i.e., em repair). Despite some recent work in MAS failure attribution, automated mechanisms to recover from such mistakes remain largely unexplored. To bridge this gap, we propose MARS, a search-based framework that formulates MAS repair as a Monte Carlo Tree Search (MCTS) process and navigates the vast space of potential repairs via diagnosis-guided expansion with taxonomy-augmented evaluation. Unlike standard MCTS, which evaluates a complete simulation via full rollout, MARS evaluates the agent trajectory using partial rollout to reduce token consumption. Furthermore, we introduce StateMAS, a large-scale MAS repair benchmark with 1,310 replayable multi-agent failure trajectories spanning four types of agent architectures and four LLM backbones. Experiments on StateMAS demonstrate that MARS consistently outperforms state-of-the-art methods, achieving an absolute improvement from 3.0% to 12.1% across all settings, while maintaining a comparable token consumption cost. The ablation study further confirms that taxonomy-augmented evaluation and diagnosis-guided expansion are critical to achieving these performance gains.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 41 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
17 of 41 references.
Closest ancestors · 4
Same direction, newest first
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
- 2025Interactive Debugging and Steering of Multi-Agent AI Systems3 Mar
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scale9 Sep
- 2023ChatDev: Communicative Agents for Software Development16 Jul
Other references · 13
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
- 2023Planning with Large Language Models for Code Generationcited by 179
- 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?cited by 155
- 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 100
- 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Searchcited by 38
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Repair or Resample? Rethinking Failure Debugging in LLM Multi-Agent Systems
- 2026PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agents
- 2025Beyond Accuracy: Behavioral Dynamics of Agentic Multi-Hunk Repair
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation
- 2026AgentTether: Graph-Guided Diagnosis and Runtime Intervention for Reliable LLM Agent Operation
- 2026ParaRecover: A Process-Level Benchmark for Error Localization and Recovery in Parallel Tool-Use Agents
- 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems