mlsanityData to 7 Oct 2026

Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs

arXiv 2604.16753 ↗First posted 17 Apr 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

As large language models (LLMs) transition into autonomous agents integrated with extensive tool ecosystems, traditional routing heuristics increasingly succumb to context pollution and "overthinking". We argue that the bottleneck is not a deficit in algorithmic capability or skill diversity, but the absence of disciplined second-order metacognitive governance. In this paper, our scientific contribution focuses on the computational translation of human cognitive control - specifically, delayed appraisal, epistemic vigilance, and region-of-proximal offloading - into a single-agent architecture. We introduce MESA-S (Metacognitive Skills for Agents, Single-agent), a preliminary framework that shifts scalar confidence estimation into a vector separating self-confidence (parametric certainty) from source-confidence (trust in retrieved external procedures). By formalizing a delayed procedural probe mechanism and introducing Metacognitive Skill Cards, MESA-S decouples the awareness of a skill's utility from its token-intensive execution. Evaluated under an In-Context Static Benchmark Evaluation natively executed via Gemini 3.1 Pro, our early results suggest that explicitly programming trust provenance and delayed escalation mitigates supply-chain vulnerabilities, prunes unnecessary reasoning loops, and prevents offloading-induced confidence inflation. This architecture offers a scientifically cautious, behaviorally anchored step toward reliable, epistemically vigilant single-agent orchestration.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 11 of its 23 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

11 of 23 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025SMART: Self-Aware Agent for Tool Overuse Mitigation17 Feb

Other references · 10

  1. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
  2. 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scalecited by 94
  3. 2026SkillRouter: Skill Routing for LLM Agents at Scalecited by 57
  4. 2025Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviorscited by 28
  5. 2026Agentic Uncertainty Quantificationcited by 16
  6. 2026When More Thinking Hurts: Overthinking in LLM Test-Time Compute Scalingcited by 13
  7. 2026LLMs Should Express Uncertainty Explicitlycited by 6
  8. 2025Metacognition and Confidence Dynamics in Advice Taking from Generative AIcited by 3
  9. 2026CoT2-Meta: Budgeted Metacognitive Control for Test-Time Reasoningcited by 2
  10. 2026Think2: Grounded Metacognitive Reasoning in Large Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MetaCogAgent: A Metacognitive Multi-Agent LLM Framework with Self-Aware Task Delegation
  2. 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security
  3. 2026Demystifying Agent Skills: Why They Work-Until They Don't
  4. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward
  5. 2024Competence-Aware AI Agents with Metacognition for Unknown Situations and Environments (MUSE)
  6. 2026SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior
  7. 2026From Knowing to Acting: Benchmarking Self-Awareness Capability of LLM Agents
  8. 2026Harnessing Agent Skills: Architectural Patterns and a Reference Architecture for Skill-Mediated LLM Agents