mlsanityData to 14 Oct 2026

Probing the Trajectories of Reasoning Traces in Large Language Models

arXiv 2601.23163 ↗First posted 30 Jan 2026cs.LG cs.AIcited by 7

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and whether intermediate trace segments provide answer-relevant information beyond generic length or stylistic effects. Here, we propose a protocol to systematically probe the trajectories of reasoning traces in LLMs by 1) generating a model's reasoning trace, 2) truncating it at fixed token-percentiles, and 3) injecting each partial trace back into the model (or a different model) to measure the induced distribution over answer choices via next-token probabilities. We apply this protocol to the open-source Qwen3-4B/-8B/-14B and gpt-oss-20b/-120b models across the multiple-choice GPQA Diamond and MMLU-Pro benchmarks. We find that accuracy and decision commitment consistently increase as the percentage of provided reasoning tokens grows. These gains are primarily driven by relevant content in the model generation rather than context length or generic "reasoning style" effects. Stronger models often backtrack successfully from incorrect partial traces, but immediate answers often remain anchored in the weaker model's incorrect response. More broadly, we show that trajectory probing provides diagnostics for efficient and safer deployment of reasoning models as the measurements can inform practical trace-handling and monitoring policies that improve reliability without assuming intermediate tokens are inherently faithful explanations.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 38 of its 54 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

38 of 54 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning11 Oct
  2. 2025Deep Think with Confidence21 Aug
  3. 2025Lexical Hints of Accuracy in LLM Reasoning Chains19 Aug
  4. 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
  5. 2025How Well Can Reasoning Models Identify and Recover from Unhelpful Thoughts?12 Jun
  6. 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models28 May
  7. 2025Reasoning Models Better Express Their Confidence20 May
  8. 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs30 Apr
  9. 2025Efficient Reasoning for LLMs through Speculative Chain-of-Thought27 Apr
  10. 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Models18 Apr
  11. 2025The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer21 Feb
  12. 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
3 more
  1. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  2. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
  3. 2022Language Models (Mostly) Know What They Know11 Jul

Other references · 23

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  3. 2024OpenAI o1 System Cardcited by 1,244
  4. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  5. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
  6. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
  7. 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 559
  8. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  9. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
  10. 2024Measuring short-form factuality in large language modelscited by 373
  11. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
  12. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
11 more
  1. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
  2. 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 129
  3. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
  4. 2025DeepSeek-R1 Thoughtology: Let's think about LLM Reasoningcited by 92
  5. 2025Monitoring Monitorabilitycited by 58
  6. 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokenscited by 41
  7. 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 40
  8. 2025Position: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces!cited by 37
  9. 2025Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Thinkcited by 16
  10. 2025Estimating problem difficulty without ground truth using Large Language Model comparisonscited by 4
  11. 2025Reasoning Relay: Evaluating Stability and Interchangeability of Large Language Models in Mathematical Reasoningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Large Language Models Decide Early and Explain Later
  2. 2026PRISM: A Dual View of LLM Reasoning through Semantic Flow and Latent Computation
  3. 2025Tracing the Traces: Latent Temporal Signals for Efficient and Accurate Reasoning
  4. 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis
  5. 2026Dissecting Failure Dynamics in Large Language Model Reasoning
  6. 2025Thought calibration: Efficient and confident test-time scaling
  7. 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation
  8. 2026Revisiting Complete Reasoning Traces for Post-Training