Decomposing and Steering Functional Metacognition in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) increasingly exhibit behaviors suggesting awareness of their evaluation context, often adapting their reasoning strategies in benchmark settings. Prior work has shown that such evaluation awareness can distort performance measurements; however, it remains unclear whether this phenomenon reflects a single behavioral artifact or a deeper internal structure within the model. We propose that LLMs maintain a decomposable space of functional metacognitive states: internal variables encoding factors such as evaluation awareness, self-assessed capability, perceived risk, computational effort allocation, audience expertise adaptation, and intentionality. Through residual stream analysis across multiple reasoning models, we demonstrate that these states are linearly decodable from internal activations and exhibit distinct layer-wise profiles. Moreover, by steering model activations along probe-derived directions, we show that each functional metacognitive state causally modulates reasoning behavior in dissociable ways, affecting verbosity, accuracy, and safety-related responses across tasks. Our findings suggest that benchmark performance reflects not only task competence but also the activation of specific functional metacognitive states. We argue that understandi ng and controlling these internal states is essential for reliable evaluation and deployment of reasoning models, and we provide a mechanistic framework for studying functional m etacognition in artificial systems. Our code and data are publicly available at https://github.com/xlands/meta-cognition.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 26 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
8 of 26 references.
References · 8
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022Toy Models of Superpositioncited by 971
- 2025FaithCoT-Bench: Benchmarking Instance-Level Faithfulness of Chain-of-Thought Reasoningcited by 26
- 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBenchcited by 21
- 2025Line Goes Up? Inherent Limitations of Benchmarks for Evaluating Large Language Modelscited by 14
- 2025Probe-Rewrite-Evaluate: A Workflow for Reliable Benchmarks and Quantifying Evaluation Awarenesscited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MIRROR: A Hierarchical Benchmark for Metacognitive Calibration in Large Language Models
- 2026LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
- 2026Think2: Grounded Metacognitive Reasoning in Large Language Models
- 2026Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning
- 2025Large Language Models Have Intrinsic Meta-Cognition, but Need a Good Lens
- 2025Meta-R1: Empowering Large Reasoning Models with Metacognition
- 2026Explaining Too Much? Understanding How Large Language Model Reasoning Traces Influence Performance and Metacognition
- 2023Metacognitive Prompting Improves Understanding in Large Language Models