Me, Myself, and π : Evaluating and Explaining LLM Introspection
Not on the map. Why?
Abstract (arXiv)
A hallmark of human intelligence is Introspection-the ability to assess and reason about one's own cognitive processes. Introspection has emerged as a promising but contested capability in large language models (LLMs). However, current evaluations often fail to distinguish genuine meta-cognition from the mere application of general world knowledge or text-based self-simulation. In this work, we propose a principled taxonomy that formalizes introspection as the latent computation of specific operators over a model's policy and parameters. To isolate the components of generalized introspection, we present Introspect-Bench, a multifaceted evaluation suite designed for rigorous capability testing. Our results show that frontier models exhibit privileged access to their own policies, outperforming peer models in predicting their own behavior. Furthermore, we provide causal, mechanistic evidence explaining both how LLMs learn to introspect without explicit training, and how the mechanism of introspection emerges via attention diffusion.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
16 of 30 references.
References · 16
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 731
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
- 2023The Internal State of an LLM Knows When It's Lyingcited by 644
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 399
- 2023Fine-tuning Language Models for Factualitycited by 219
- 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 105
4 more
- 2026Emergent Introspective Awareness in Large Language Modelscited by 73
- 2025RL-Obfuscation: Can Language Models Learn to Evade Latent-Space Monitors?cited by 19
- 2025Because we have LLMs, we Can and Should Pursue Agentic Interpretabilitycited by 14
- 2024DiffusionAttacker: Diffusion-Driven Prompt Manipulation for LLM Jailbreakcited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.