Probing the Trajectories of Reasoning Traces in Large Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and whether intermediate trace segments provide answer-relevant information beyond generic length or stylistic effects. Here, we propose a protocol to systematically probe the trajectories of reasoning traces in LLMs by 1) generating a model's reasoning trace, 2) truncating it at fixed token-percentiles, and 3) injecting each partial trace back into the model (or a different model) to measure the induced distribution over answer choices via next-token probabilities. We apply this protocol to the open-source Qwen3-4B/-8B/-14B and gpt-oss-20b/-120b models across the multiple-choice GPQA Diamond and MMLU-Pro benchmarks. We find that accuracy and decision commitment consistently increase as the percentage of provided reasoning tokens grows. These gains are primarily driven by relevant content in the model generation rather than context length or generic "reasoning style" effects. Stronger models often backtrack successfully from incorrect partial traces, but immediate answers often remain anchored in the weaker model's incorrect response. More broadly, we show that trajectory probing provides diagnostics for efficient and safer deployment of reasoning models as the measurements can inform practical trace-handling and monitoring policies that improve reliability without assuming intermediate tokens are inherently faithful explanations.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 38 of its 54 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
38 of 54 references.
Closest ancestors · 15
Same direction, newest first
- 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning11 Oct
- 2025Deep Think with Confidence21 Aug
- 2025Lexical Hints of Accuracy in LLM Reasoning Chains19 Aug
- 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
- 2025How Well Can Reasoning Models Identify and Recover from Unhelpful Thoughts?12 Jun
- 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models28 May
- 2025Reasoning Models Better Express Their Confidence20 May
- 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs30 Apr
- 2025Efficient Reasoning for LLMs through Speculative Chain-of-Thought27 Apr
- 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Models18 Apr
- 2025The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer21 Feb
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
3 more
Other references · 23
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 559
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
- 2024Measuring short-form factuality in large language modelscited by 373
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
11 more
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 129
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
- 2025DeepSeek-R1 Thoughtology: Let's think about LLM Reasoningcited by 92
- 2025Monitoring Monitorabilitycited by 58
- 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokenscited by 41
- 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 40
- 2025Position: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces!cited by 37
- 2025Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Thinkcited by 16
- 2025Estimating problem difficulty without ground truth using Large Language Model comparisonscited by 4
- 2025Reasoning Relay: Evaluating Stability and Interchangeability of Large Language Models in Mathematical Reasoningcited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026On the Role of Reasoning Patterns in the Generalization Discrepancy of Long Chain-of-Thought Supervised Fine-Tuningcited by 4
- 2026Shorter Reasoning, Earlier Answers? An Evaluation of Reasoning Interfacescited by 1
- 2026It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectoriescited by 1
- 2026Diagnosing Harmful Continuation in Answer-Correct Long-CoT Training Tracescited by 0
- 2026State of Thought Enables Endogenous Reasoningcited by 0
- 2026When Confidence Rises Too Early: Detecting Shortcut Reasoning via Premature Answer Commitmentcited by 0
- 2026Argument Graph Uncertainty: Quantifying Uncertainty from the Logical Structure of Reasoning Chainscited by 0
- 2026Argument Graph Uncertainty: Quantifying Uncertainty from the Logical Structure of Reasoning Chains14 Oct 2026
- 2026When Confidence Rises Too Early: Detecting Shortcut Reasoning via Premature Answer Commitment28 Sep 2026
- 2026State of Thought Enables Endogenous Reasoning13 Sep 2026
- 2026It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories3 Sep 2026
- 2026Shorter Reasoning, Earlier Answers? An Evaluation of Reasoning Interfaces4 Aug 2026
- 2026Diagnosing Harmful Continuation in Answer-Correct Long-CoT Training Traces28 May 2026
- 2026On the Role of Reasoning Patterns in the Generalization Discrepancy of Long Chain-of-Thought Supervised Fine-Tuning2 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Large Language Models Decide Early and Explain Later
- 2026PRISM: A Dual View of LLM Reasoning through Semantic Flow and Latent Computation
- 2025Tracing the Traces: Latent Temporal Signals for Efficient and Accurate Reasoning
- 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis
- 2026Dissecting Failure Dynamics in Large Language Model Reasoning
- 2025Thought calibration: Efficient and confident test-time scaling
- 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation
- 2026Revisiting Complete Reasoning Traces for Post-Training