Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstruction
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large Language Model based multi-agent systems (MAS) excel at collaborative problem solving but remain brittle to cascading errors: a single faulty step can propagate across agents and disrupt the trajectory. In this paper, we present MASC, a metacognitive framework that endows MAS with real-time, unsupervised, step-level error detection and self-correction. MASC rethinks detection as history-conditioned anomaly scoring via two complementary designs: (1) Next-Execution Reconstruction, which predicts the embedding of the next step from the query and interaction history to capture causal consistency, and (2) Prototype-Guided Enhancement, which learns a prototype prior over normal-step embeddings and uses it to stabilize reconstruction and anomaly scoring under sparse context (e.g., early steps). When an anomaly step is flagged, MASC triggers a correction agent to revise the acting agent's output before information flows downstream. On the Who&When benchmark, MASC consistently outperforms all baselines, improving step-level error detection by up to 8.47% AUC-ROC ; When plugged into diverse MAS frameworks, it delivers consistent end-to-end gains across architectures, confirming that our metacognitive monitoring and targeted correction can mitigate error propagation with minimal overhead.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 52 of its 69 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
52 of 69 references.
Closest ancestors · 9
Same direction, newest first
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation24 Jul
- 2025AnyMAC: Cascading Flexible Multi-Agent Collaboration via Next-Agent Prediction21 Jun
- 2025Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systems29 May
- 2025Multi-Agent Collaboration via Evolving Orchestration26 May
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2024SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agents5 Nov
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
- 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 43
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
31 more
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 650
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 437
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
- 2016Solving General Arithmetic Word Problemscited by 360
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 288
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 185
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2025Where LLM Agents Fail and How They can Learn From Failurescited by 133
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 106
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 94
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimizationcited by 84
- 2024Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agentscited by 65
- 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systemscited by 59
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 55
- 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 38
- 2025Optimizing Model Selection for Compound AI Systemscited by 36
- 2024NetSafe: Exploring the Topological Safety of Multi-agent Networkscited by 29
- 2025TemplateRL: Structured Template-Guided Reinforcement Learning for LLM Reasoningcited by 28
- 2025Weak-for-Strong: Training Weak Meta-Agent to Harness Strong Executorscited by 22
- 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systemscited by 22
- 2025Learning from Diverse Reasoning Paths with Routing and Collaborationcited by 12
- 2025To trust or not to trust: Attention-based Trust Management for LLM Multi-Agent Systemscited by 6
- 2025Evaluating Large Language Models for Cross-Lingual Retrievalcited by 5
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 6
- 2026Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascadecited by 4
- 2026Yunque DeepResearch Technical Reportcited by 3
- 2026ProMAS: Proactive Error Forecasting for Multi-Agent Systems Using Markov Transition Dynamicscited by 3
- 2026When Planning Fails Despite Correct Execution: On Epistemic Calibration for LLM-Based Multi-Agent Systemscited by 3
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2026Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labelscited by 0
- 2026Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labels9 Oct 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade7 Jul 2026
- 2026When Planning Fails Despite Correct Execution: On Epistemic Calibration for LLM-Based Multi-Agent Systems22 May 2026
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May 2026
- 2026ProMAS: Proactive Error Forecasting for Multi-Agent Systems Using Markov Transition Dynamics12 Mar 2026
- 2026Yunque DeepResearch Technical Report27 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems
- 2025CORRECT: COndensed eRror RECognition via knowledge Transfer in multi-agent systems
- 2026MetaCogAgent: A Metacognitive Multi-Agent LLM Framework with Self-Aware Task Delegation
- 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision
- 2026Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training
- 2026Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learning
- 2025AgentAsk: Multi-Agent Systems Need to Ask