How Do Answer Tokens Read Reasoning Traces? Self-Reading Patterns in Thinking LLMs for Quantitative Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Thinking LLMs produce reasoning traces before answering. Prior activation steering work mainly targets on shaping these traces. It remains less understood how answer tokens actually read and integrate the reasoning to produce reliable outcomes. Focusing on quantitative reasoning, we analyze the answer-to-reasoning attention and observe a benign self-reading pattern aligned with correctness, characterized by a forward drift of the reading focus along the reasoning trace and a persistent concentration on key semantic anchors, whereas incorrect solutions exhibit diffuse and irregular attention pattern. We interpret this as internal certainty during answer decoding, where the model commits to a viable solution branch and integrates key evidence. Following this, we propose a training-free steering method driven by Self-Reading Quality (SRQ) scores combining geometric metrics for process control with semantic metrics for content monitoring. SRQ selects data to build steering vectors that guide inference toward benign self-reading and away from uncertain and disorganized reading. Experiments show that our method yields consistent accuracy gains.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 16 of its 32 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
16 of 32 references.
Closest ancestors · 7
Same direction, newest first
- 2025From Reasoning to Answer: Empirical, Attention-Based and Mechanistic Insights into Distilled DeepSeek R1 Models28 Sep
- 2025Answering the Unanswerable Is to Err Knowingly: Analyzing and Mitigating Abstention Failures in Large Reasoning Models26 Aug
- 2025Activation Steering for Chain-of-Thought Compression7 Jul
- 2025Understanding Reasoning in Thinking Language Models via Steering Vectors22 Jun
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
- 2025ThinkEdit: Interpretable Weight Editing to Mitigate Overly Short Thinking in Reasoning Models27 Mar
Other references · 9
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2024Steering Large Language Models using Conceptors: Improving Addition-Based Activation Engineeringcited by 33
- 2025Feature Extraction and Steering for Enhanced Chain-of-Thought Reasoning in Language Modelscited by 12
- 2025Activation Control for Efficiently Eliciting Long Chain-of-thought Ability of Language Modelscited by 12
- 2025Entropy-Lens: Uncovering Decision Strategies in LLMscited by 6
- 2025But what is your honest answer? Aiding LLM-judges with honest alternatives using steering vectorscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Can Large Language Models "Hyper-Thread"?cited by 0
- 2026Can Large Language Models "Hyper-Thread"?23 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs
- 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verification
- 2025Do Cognitively Interpretable Reasoning Traces Improve LLM Performance?
- 2025Revisiting Overthinking in Long Chain-of-Thought from the Perspective of Self-Doubt
- 2025Tracing the Traces: Latent Temporal Signals for Efficient and Accurate Reasoning
- 2026When Chain-of-Thought Fails, the Solution Hides in the Hidden States
- 2025Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Think
- 2025Confidence Improves Self-Consistency in LLMs