Efficient Failure Management for Multi-Agent Systems with Reasoning Trace Representation
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Large Language Models (LLM)-based Multi-Agent Systems (MASs) have emerged as a new paradigm in software system design, increasingly demonstrating strong reasoning and collaboration capabilities. As these systems become more complex and autonomous, effective failure management is essential to ensure reliability and availability. However, existing approaches often rely on per-trace reasoning, which leads to low efficiency, and neglect historical failure patterns, limiting diagnostic accuracy. In this paper, we conduct a preliminary empirical study to demonstrate the necessity, potential, and challenges of leveraging historical failure patterns to enhance failure management in MASs. Building on this insight, we propose EAGER, an efficient failure management framework for multi-agent systems based on reasoning trace representation. EAGER employs unsupervised reasoning-scoped contrastive learning to encode both intra-agent reasoning and inter-agent coordination, enabling real-time step-wise failure detection, diagnosis, and reflexive mitigation guided by historical failure knowledge. Preliminary evaluations on three open-source MASs demonstrate the effectiveness of EAGER and highlight promising directions for future research in reliable multi-agent system operations.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 31 of its 51 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
31 of 51 references.
Closest ancestors · 8
Same direction, newest first
- 2026Agentic Memory Enhanced Recursive Reasoning for Root Cause Localization in Microservices6 Jan
- 2025MicroRemed: Benchmarking LLMs in Microservices Remediation3 Nov
- 2025RAFFLES: Reasoning-based Attribution of Faults for LLM Systems8 Sep
- 2025Adaptive Root Cause Localization for Microservice Systems with Multi-Agent Recursion-of-Thought28 Aug
- 2025A Survey on AgentOps: Categorization, Challenges, and Future Directions4 Aug
- 2025SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution31 Jul
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
- 2025TRAIL: Trace Reasoning and Agentic Issue Localization13 May
Other references · 23
- 2025Qwen3 Technical Reportcited by 8,195
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
- 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systemscited by 56
- 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modelingcited by 35
- 2025Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysiscited by 33
- 2024Multi-Agent Collaboration via Cross-Team Orchestrationcited by 30
- 2025A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language Modelscited by 27
- 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Taskscited by 20
- 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systemscited by 19
11 more
- 2025ThinkFL: Self-Refining Failure Localization for Microservice Systems via Reinforcement Fine-Tuningcited by 17
- 2025An Empirical Study on Failures in Automated Issue Solvingcited by 15
- 2025Abduct, Act, Predict: Scaffolding Causal Inference for Automated Failure Attribution in Multi-Agent Systemscited by 14
- 2025Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Modelscited by 13
- 2025ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Developmentcited by 11
- 2025Demystifying the Lifecycle of Failures in Platform-Orchestrated Agentic Workflowscited by 10
- 2025Walk the Talk: Is Your Log-based Software Reliability Maintenance System Really Reliable?cited by 9
- 2025MICA: Multi-Agent Industrial Coordination Assistantcited by 8
- 2025United We Stand: Towards End-to-End Log-based Fault Diagnosis via Interactive Multi-Task Learningcited by 7
- 2026Hypothesize-Then-Verify: Speculative Root Cause Analysis for Microservices with Pathwise Parallelismcited by 7
- 2025LogAction: Consistent Cross-system Anomaly Detection through Logs via Active Domain Adaptationcited by 5
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
- 2026From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discoverycited by 4
- 2026E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuningcited by 3
- 2026Towards Robust LLM Post-Training: Automatic Failure Management for Reinforcement Fine-Tuningcited by 2
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thoughtcited by 0
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Design14 Jun 2026
- 2026From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discovery14 May 2026
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thought14 May 2026
- 2026Towards Robust LLM Post-Training: Automatic Failure Management for Reinforcement Fine-Tuning6 May 2026
- 2026E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuning13 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems
- 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems
- 2026StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems
- 2026DCFA: Dual-view Causal-inspired Attribution for Failure Reasoning in LLM-based Multi-agent Systems
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems
- 2026POIROT: Interrogating Agents for Failure Detection in Multi-Agent Systems
- 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems