mlsanityData to 7 Oct 2026

Minimal and Mechanistic Conditions for Behavioral Self-Awareness in LLMs

arXiv 2511.04875 ↗First posted 6 Nov 2025cs.CL cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent studies have revealed that LLMs can exhibit behavioral self-awareness: the ability to accurately describe or predict their own learned behaviors without explicit supervision. This capability raises safety concerns as it may, for example, allow models to better conceal their true abilities during evaluation. We attempt to characterize the minimal conditions under which such self-awareness emerges, and the mechanistic processes through which it manifests. Through controlled finetuning experiments on instruction-tuned LLMs with low-rank adapters (LoRA), we find: (1) that self-awareness can be reliably induced using a single rank-1 LoRA adapter; (2) that the learned self-aware behavior can be largely captured by a single steering vector in activation space, recovering nearly all of the fine-tune's behavioral effect; and (3) that self-awareness is non-universal and domain-localized, with independent representations across tasks. Together, these findings suggest that behavioral self-awareness emerges as a domain-specific, linear feature that can be easily induced and modulated.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 10 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

9 of 10 references.

References · 9

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  3. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  4. 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 105
  5. 2025Tell me about yourself: LLMs are aware of their learned behaviorscited by 86
  6. 2025One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMscited by 27
  7. 2025Does It Make Sense to Speak of Introspection in Large Language Models?cited by 22
  8. 2024Self-Cognition in Large Language Models: An Exploratory Studycited by 14
  9. 2025Simple Mechanistic Explanations for Out-Of-Context Reasoningcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.