ProMAS: Proactive Error Forecasting for Multi-Agent Systems Using Markov Transition Dynamics
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
The integration of Large Language Models into Multi-Agent Systems (MAS) has enabled the so-lution of complex, long-horizon tasks through collaborative reasoning. However, this collec-tive intelligence is inherently fragile, as a single logical fallacy can rapidly propagate and lead to system-wide failure. Most current research re-lies on post-hoc failure analysis, thereby hinder-ing real-time intervention. To address this, we propose PROMAS, a proactive framework utiliz-ing Markov transitions for predictive error anal-ysis. PROMAS extracts Causal Delta Features to capture semantic displacement, mapping them to a quantized Vector Markov Space to model reasoning as probabilistic transitions. By inte-grating a Proactive Prediction Head with Jump Detection, the method localizes errors via risk acceleration rather than static thresholds. On the Who&When benchmark, PROMAS achieves 22.97% step-level accuracy while processing only 27% of reasoning logs. This performance rivals reactive monitors like MASC while reducing data overhead by 73%. Although this strategy entails an accuracy trade-off compared to post-hoc meth-ods, it significantly improves intervention latency, balancing diagnostic precision with the real-time demands of autonomous reasoning.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 29 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
26 of 29 references.
Closest ancestors · 9
Same direction, newest first
- 2025Where LLM Agents Fail and How They can Learn From Failures29 Sep
- 2025Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysis17 Sep
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
- 2023ChatDev: Communicative Agents for Software Development16 Jul
- 2023Self-collaboration Code Generation via ChatGPT15 Apr
Other references · 17
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
- 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systemscited by 108
- 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 104
- 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 64
- 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49
5 more
- 2025A Survey of Large Language Model Agents for Question Answeringcited by 46
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2025ProbGuard: Proactive Runtime Monitoring for LLM Agent Safety via Probabilistic Predictioncited by 25
- 2025Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstructioncited by 6
- 2025Video-QTR: Query-Driven Temporal Reasoning Framework for Lightweight Video Understandingcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025CORRECT: COndensed eRror RECognition via knowledge Transfer in multi-agent systems
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems
- 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systems
- 2026Conformal Agent Error Attribution
- 2026PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety
- 2026Sequential Probabilistic Uncertainty Estimation for Parallel Multi-Agent Reasoning Systems
- 2025Abduct, Act, Predict: Scaffolding Causal Inference for Automated Failure Attribution in Multi-Agent Systems