mlsanityData to 7 Oct 2026

Tracing the Traces: Latent Temporal Signals for Efficient and Accurate Reasoning

arXiv 2510.10494 ↗First posted 12 Oct 2025cs.AIcited by 8

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Reasoning models improve their problem-solving ability through inference-time scaling, allocating more compute via longer token budgets. Identifying which reasoning traces are likely to succeed remains a key opportunity: reliably predicting productive paths can substantially reduce wasted computation and improve overall efficiency. We introduce Latent-Trajectory signals that characterize the temporal evolution of a model's internal representations during the generation of intermediate reasoning tokens. By measuring the overall change in latent representations between the start and end of reasoning, the change accumulated across intermediate steps, and the extent to which these changes advance toward the final state, we show that these signals predict solution accuracy more reliably than both cross-layer metrics and output-based confidence measures. When used to guide answer selection across multiple sampled generations, Latent-Trajectory signals make test-time scaling more effective and efficient than majority voting, reducing token usage by up to 70% while preserving and even improving accuracy by 2.6% on average. Moreover, these predictive signals often emerge early in the reasoning trace, enabling early selection and allocation of compute to the most promising candidates. Our findings contribute not only practical strategies for inference-time efficiency, but also a deeper interpretability perspective on how reasoning processes are represented and differentiated in latent space.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 40 of its 43 references that are in the map. First posted on arXiv 12 Oct 2025.

Builds on

40 of 43 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025CoRE: Enhancing Metacognition with Label-free Self-evaluation in LRMs8 Jul
  2. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity7 Jun
  3. 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoning23 May
  4. 2025Dynamic Early Exit in Reasoning Models22 Apr
  5. 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verification7 Apr
  6. 2025Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead31 Mar
  7. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  8. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
  9. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  10. 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
  11. 2024Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation3 Oct
  12. 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoning26 Apr
2 more
  1. 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoning19 Jan
  2. 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar

Other references · 26

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  6. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  7. 2023Steering Language Models With Activation Engineeringcited by 824
  8. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  9. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  10. 2025Reasoning Models Don't Always Say What They Thinkcited by 388
  11. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
  12. 2022Large Language Models are Better Reasoners with Self-Verificationcited by 304
14 more
  1. 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
  2. 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 175
  3. 2025Phi-4-reasoning Technical Reportcited by 146
  4. 2025DeepSeek-R1 Thoughtology: Let's think about LLM Reasoningcited by 91
  5. 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoningcited by 75
  6. 2023Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Modelscited by 67
  7. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
  8. 2024Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluationcited by 56
  9. 2025OMEGA: Can LLMs Reason Outside the Box in Math? Evaluating Exploratory, Compositional, and Transformative Generalizationcited by 48
  10. 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokenscited by 41
  11. 2023Large language models implicitly learn to straighten neural sentence trajectories to construct a predictive representation of natural languagecited by 32
  12. 2025Knowledge or Reasoning? A Close Look at How LLMs Think Across Domainscited by 14
  13. 2025The CoT Encyclopedia: Analyzing, Predicting, and Controlling how a Reasoning Model will Thinkcited by 9
  14. 2022Useful Confidence Measures: Beyond the Max Scorecited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Probing the Trajectories of Reasoning Traces in Large Language Models
  2. 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation
  3. 2026Emergent Search and Backtracking in Latent Reasoning Models
  4. 2026GTS: Inference-Time Scaling of Latent Reasoning with a Learnable Gaussian Thought Sampler
  5. 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis
  6. 2026ThinkRouter: Efficient Reasoning via Routing Thinking between Latent and Discrete Spaces
  7. 2026How Do Latent Reasoning Methods Perform Under Weak and Strong Supervision?
  8. 2026LatentHarness: Learning Latent Actions for Memory and Reasoning via Counterfactual Policy Distillation