mlsanityData to 7 Oct 2026

Agentic Metacognition: Designing a "Self-Aware" Low-Code Agent for Failure Prediction and Human Handoff

arXiv 2509.19783 ↗First posted 24 Sep 2025cs.AI cs.HC cs.SEcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

The inherent non-deterministic nature of autonomous agents, particularly within low-code/no-code (LCNC) environments, presents significant reliability challenges. Agents can become trapped in unforeseen loops, generate inaccurate outputs, or encounter unrecoverable failures, leading to user frustration and a breakdown of trust. This report proposes a novel architectural pattern to address these issues: the integration of a secondary, "metacognitive" layer that actively monitors the primary LCNC agent. Inspired by human introspection, this layer is designed to predict impending task failures based on a defined set of triggers, such as excessive latency or repetitive actions. Upon predicting a failure, the metacognitive agent proactively initiates a human handoff, providing the user with a clear summary of the agent's "thought process" and a detailed explanation of why it could not proceed. An empirical analysis of a prototype system demonstrates that this approach significantly increases the overall task success rate. However, this performance gain comes with a notable increase in computational overhead. The findings reframe human handoffs not as an admission of defeat but as a core design feature that enhances system resilience, improves user experience, and builds trust by providing transparency into the agent's internal state. The report discusses the practical and ethical implications of this approach and identifies key directions for future research.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 5 of its 22 references that are in the map. First posted on arXiv 24 Sep 2025.

Builds on

5 of 22 references.

References · 5

  1. 2025SMART: Self-Aware Agent for Tool Overuse Mitigationcited by 52
  2. 2024Adaptive Optimization for Enhanced Efficiency in Large-Scale Language Model Trainingcited by 13
  3. 2025Combining Cost-Constrained Runtime Monitors for AI Safetycited by 10
  4. 2025FaMA: LLM-Empowered Agentic Assistant for Consumer-to-Consumer Marketplacecited by 4
  5. 2025From Passive Tool to Socio-cognitive Teammate: A Conceptual Framework for Agentic AI in Human-AI Collaborative Learningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs
  2. 2024Competence-Aware AI Agents with Metacognition for Unknown Situations and Environments (MUSE)
  3. 2026From Knowing to Acting: Benchmarking Self-Awareness Capability of LLM Agents
  4. 2026MetaCogAgent: A Metacognitive Multi-Agent LLM Framework with Self-Aware Task Delegation
  5. 2025Truly Self-Improving Agents Require Intrinsic Metacognitive Learning
  6. 2024Metacognition is all you need? Using Introspection in Generative Agents to Improve Goal-directed Behavior
  7. 2025Adapting Like Humans: A Metacognitive Agent with Test-time Reasoning
  8. 2026The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development?