From Latent Signals to Reflection Behavior: Tracing Meta-Cognitive Activation Trajectory in R1-Style LLMs
Not on the map. Why?
Abstract (arXiv)
R1-style LLMs have attracted growing attention for their capacity for self-reflection, yet the internal mechanisms underlying such behavior remain unclear. To bridge this gap, we anchor on the onset of reflection behavior and trace its layer-wise activation trajectory. Using the logit lens to read out token-level semantics, we uncover a structured progression: (i) Latent-control layers, where an approximate linear direction encodes the semantics of thinking budget; (ii) Semantic-pivot layers, where discourse-level cues, including turning-point and summarization cues, surface and dominate the probability mass; and (iii) Behavior-overt layers, where the likelihood of reflection-behavior tokens begins to rise until they become highly likely to be sampled. Moreover, our targeted interventions uncover a causal chain across these stages: prompt-level semantics modulate the projection of activations along latent-control directions, thereby inducing competition between turning-point and summarization cues in semantic-pivot layers, which in turn regulates the sampling likelihood of reflection-behavior tokens in behavior-overt layers. Collectively, our findings suggest a human-like meta-cognitive process-progressing from latent monitoring, to discourse-level regulation, and to finally overt self-reflection. Our analysis code can be found at https://github.com/DYR1/S3-CoT.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
20 of 28 references.
References · 20
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2025Training Language Models to Reason Efficientlycited by 247
8 more
- 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verificationcited by 159
- 2024How Alignment and Jailbreak Work: Explain LLM Safety through Intermediate Hidden Statescited by 98
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiencycited by 66
- 2024Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewardingcited by 55
- 2024Iteration Head: A Mechanistic Study of Chain-of-Thoughtcited by 31
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 27
- 2025From Emergence to Control: Probing and Modulating Self-Reflection in Language Modelscited by 6
- 2025Unsupervised decoding of encoded reasoning using language model interpretabilitycited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Unveiling the Latent Directions of Reflection in Large Language Models
- 2026CBMAS: Cognitive Behavioral Modeling via Activation Steering
- 2025Latent Debate: A Surrogate Framework for Interpreting LLM Thinking
- 2026Measuring Activation Control in Large Language Models
- 2025Belief Dynamics Reveal the Dual Nature of In-Context Learning and Activation Steering
- 2025Emergent Bayesian Behaviour and Optimal Cue Combination in LLMs
- 2026When Steering Fails in Latent Reasoning: A Latent-to-Language Transition Gap
- 2026LLM Reasoning Is Latent, Not the Chain of Thought