mlsanityData to 14 Oct 2026

Unveiling the Latent Directions of Reflection in Large Language Models

arXiv 2508.16989 ↗First posted 23 Aug 2025cs.LGcited by 2

On the map: Mechanistic interpretability → Activation steering methods

Abstract (arXiv)

Reflection, the ability of large language models (LLMs) to evaluate and revise their own reasoning, has been widely used to improve performance on complex reasoning tasks. Yet, most prior works emphasizes designing reflective prompting strategies or reinforcement learning objectives, leaving the inner mechanisms of reflection underexplored. In this paper, we investigate reflection through the lens of latent directions in model activations. We propose a methodology based on activation steering to characterize how instructions with different reflective intentions: no reflection, intrinsic reflection, and triggered reflection. By constructing steering vectors between these reflection levels, we demonstrate that (1) new reflection-inducing instructions can be systematically identified, (2) reflective behavior can be directly enhanced or suppressed through activation interventions, and (3) suppressing reflection is considerably easier than stimulating it. Experiments on GSM8k-adv and Cruxeval-o-adv with Qwen2.5-3B and Gemma3-4B-IT reveal clear stratification across reflection levels, and steering interventions confirm the controllability of reflection. Our findings highlight both opportunities (e.g., reflection-enhancing defenses) and risks (e.g., adversarial inhibition of reflection in jailbreak attacks). This work opens a path toward mechanistic understanding of reflective reasoning in LLMs.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Activation steering methods, one of 13 directions in Mechanistic interpretability. Builds on 27 of its 40 references that are in the map. First posted on arXiv 23 Aug 2025.

Builds on

27 of 40 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Steering Llama 2 via Contrastive Activation Addition9 Dec

Other references · 26

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  6. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  7. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  8. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  9. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  10. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  11. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  12. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
14 more
  1. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  2. 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
  3. 2024Not All Language Model Features Are One-Dimensionally Linearcited by 212
  4. 2023Fundamental Limitations of Alignment in Large Language Modelscited by 155
  5. 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 116
  6. 2024On the Origins of Linear Representations in Large Language Modelscited by 79
  7. 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Freecited by 68
  8. 2023Concept Algebra for (Score-Based) Text-Controlled Generative Modelscited by 59
  9. 2025Reinforce LLM Reasoning through Multi-Agent Reflectioncited by 27
  10. 2025Improving Reasoning Performance in Large Language Models via Representation Engineeringcited by 23
  11. 2025Large Language Models Have Intrinsic Meta-Cognition, but Need a Good Lenscited by 10
  12. 2025MyGO Multiplex CoT: A Method for Self-Reflection in Large Language Models via Double Chain of Thought Thinkingcited by 5
  13. 2025Towards Understanding the Cognitive Habits of Large Reasoning Modelscited by 4
  14. 2025Explaining Intrinsic Moral Self-Correction with Mechanistic Interpretabilitycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Emergence to Control: Probing and Modulating Self-Reflection in Language Models
  2. 2025Rethinking Reflection in Pre-Training
  3. 2026From Latent Signals to Reflection Behavior: Tracing Meta-Cognitive Activation Trajectory in R1-Style LLMs
  4. 2024When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models
  5. 2025Illusions of reflection: open-ended task reveals systematic failures in Large Language Models' reflective reasoning
  6. 2024Self-Reflection Makes Large Language Models Safer, Less Biased, and Ideologically Neutral
  7. 2024Self-Contrast: Better Reflection Through Inconsistent Solving Perspectives
  8. 2026LoongReflect: Boosting Long-Horizon Reflection in Search Agents via Global Perspective Distillation