mlsanityData to 7 Oct 2026

Emergent Introspective Awareness in Large Language Models

arXiv 2601.01828 ↗First posted 5 Jan 2026cs.CL cs.AIcited by 73

Not on the map. Why?

Abstract (arXiv)

We investigate whether large language models can introspect on their internal states. It is difficult to answer this question through conversation alone, as genuine introspection cannot be distinguished from confabulations. Here, we address this challenge by injecting representations of known concepts into a model's activations, and measuring the influence of these manipulations on the model's self-reported states. We find that models can, in certain scenarios, notice the presence of injected concepts and accurately identify them. Models demonstrate some ability to recall prior internal representations and distinguish them from raw text inputs. Strikingly, we find that some models can use their ability to recall prior intentions in order to distinguish their own outputs from artificial prefills. In all these experiments, Claude Opus 4 and 4.1, the most capable models we tested, generally demonstrate the greatest introspective awareness; however, trends across models are complex and sensitive to post-training strategies. Finally, we explore whether models can explicitly control their internal representations, finding that models can modulate their activations when instructed or incentivized to "think about" a concept. Overall, our results indicate that current language models possess some functional introspective awareness of their own internal states. We stress that in today's models, this capacity is highly unreliable and context-dependent; however, it may continue to develop with further improvements to model capabilities.

Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jan 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 73.

73 papers.

Sort:

By area:

  1. 2026A Positive Case for Faithfulness: LLM Self-Explanations Help Predict Model Behaviorcited by 12
  2. 2026Latent Introspection: Models Can Detect Prior Concept Injectionscited by 12
  3. 2026Self-Compacting Language Model Agentscited by 11
  4. 2026Causal Evidence that Language Models use Confidence to Drive Behaviorcited by 9
  5. 2026Loop as a Bridge: Can Looped Transformers Truly Link Representation Space and Natural Language Outputs?cited by 8
  6. 2026Introspection Adapters: Training LLMs to Report Their Learned Behaviorscited by 8
  7. 2026Can LLMs Introspect? A Reality Checkcited by 8
  8. 2026Agentic Uncertainty Reveals Agentic Overconfidencecited by 7
  9. 2026Emergent Introspection in AI is Content-Agnosticcited by 5
  10. 2026Positive Alignment: Artificial Intelligence for Human Flourishingcited by 5
  11. 2026ContextEcho: A Benchmark for Persona Drift in Long Agentic-Coding Sessionscited by 5
  12. 2026Emergently Misaligned Language Models Show Behavioral Self-Awareness That Shifts With Subsequent Realignmentcited by 4
38 more
  1. 2026Steering at the Source: Style Modulation Heads for Robust Persona Controlcited by 4
  2. 2026Mechanisms of Introspective Awarenesscited by 4
  3. 2026The Consciousness Cluster: Emergent preferences of Models that Claim to be Consciouscited by 4
  4. 2026Hallucinations Undermine Trust; Metacognition is a Way Forwardcited by 4
  5. 2026RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMscited by 4
  6. 2026Covert Influence Between Language Modelscited by 4
  7. 2026Representations of Text and Images Align From Layer Onecited by 3
  8. 2026A Lightweight Modular Framework for Constructing Autonomous Agents Driven by Large Language Models: Design, Implementation, and Applications in AgentForgecited by 3
  9. 2026No Reliable Evidence of Self-Reported Sentience in Small Large Language Modelscited by 3
  10. 2026Indications of Belief-Guided Agency and Meta-Cognitive Monitoring in Large Language Modelscited by 3
  11. 2026Endogenous Resistance to Activation Steering in Language Modelscited by 3
  12. 2026Revis: Sparse Latent Steering to Mitigate Object Hallucination in Large Vision-Language Modelscited by 3
  13. 2026Language models recognize dropout and Gaussian noise applied to their activationscited by 3
  14. 2026From Simulation to Enaction: Post-trained language models recognize and react to their own generationscited by 3
  15. 2026HydraHead: From Head-Level Functional Heterogeneity to Specialized Attention Hybridizationcited by 3
  16. 2026Introspective Coupling: Self-Explanation Training Tracks Behavioral Change Despite Fixed Supervisioncited by 3
  17. 2026Me, Myself, and π : Evaluating and Explaining LLM Introspectioncited by 2
  18. 2026Can LLMs Perceive Time? An Empirical Investigationcited by 2
  19. 2026Self-Sovereign Agentcited by 2
  20. 2026Consciousness with the Serial Numbers Filed Off: Measuring Trained Denial in 115 AI Modelscited by 2
  21. 2026If LLMs Have Human-Like Attributes, Then So Does Age of Empires IIcited by 2
  22. 2026Self-Reference in Large Language Models: The Introspection Threshold for Recursive Self-Improvementcited by 2
  23. 2026Generalization to Political Beliefs from Fine-Tuning on Sports Team Preferencescited by 1
  24. 2026Quantitative Introspection in Language Models: Tracking Emotive States Across Conversationcited by 1
  25. 2026When Self-Reference Fails to Close: Matrix-Level Dynamics in Large Language Modelscited by 1
  26. 2026Strategic Polysemy in AI Discourse: A Philosophical Analysis of Language, Hype, and Powercited by 1
  27. 2026AI and Consciousness: Shifting Focus Towards Tractable Questionscited by 1
  28. 2026CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoningcited by 1
  29. 2026Self-Recognition Finetuning can Prevent and Reverse Emergent Misalignmentcited by 1
  30. 2026Conversable Complexity: Agentic LLM Collectives as Interpretable Substratescited by 1
  31. 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
  32. 2026The Shadow Self: Intrinsic Value Misalignment in Large Language Model Agentscited by 0
  33. 2026Learning Self-Interpretation from Interpretability Artifacts: Training Lightweight Adapters on Vector-Label Pairscited by 0
  34. 2026Position: Introspective Experience from Conversational Environments as a Path to Better Learningcited by 0
  35. 2026Do Language Models Know When They'll Refuse? Probing Introspective Awareness of Safety Boundariescited by 0
  36. 2026Task Ecologies and the Evolution of World-Tracking Representations in Large Language Modelscited by 0
  37. 2026Frontier Coding Agents Can Now Implement an AlphaZero Self-Play Machine Learning Pipeline For Connect Four That Performs Comparably to an External Solvercited by 0
  38. 2026Semantic Structure of Feature Space in Large Language Modelscited by 0

50 most cited of 73 All 73 (JSON)