mlsanityData to 14 Oct 2026

Directional Reasoning Trajectory Change (DRTC): Identifying Critical Trace Segments in Reasoning Models

arXiv 2602.15332 ↗First posted 17 Feb 2026cs.LGcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Understanding how language models carry out long-horizon reasoning remains an open challenge. Existing interpretability methods often highlight tokens correlated with an answer, but rarely reveal where consequential reasoning turns occur, which earlier context triggers them under causal intervention, or whether highlighted text actually steers the rollout. We introduce Directional Reasoning Trajectory Change (DRTC), a process-causal method that (i) detects pivot decision points via uncertainty and distribution-shift signals and (ii) applies receiver-side interventions that preserve the realized continuation without resampling while blocking information flow from selected earlier chunks only at a pivot. DRTC measures how each intervention redirects the log-probability trajectory relative to the realized rollout direction, yielding signed per-chunk attributions; we also compute logit-space curvature changes and curvature signatures as a complementary geometric diagnostic. Across four reasoning models, influence is sharply concentrated (Gini approximately 0.50-0.58, top-5% mass approximately 0.23-0.28), and learned pivots induce stronger effects than matched random spans. In a 500-problem MATH scaling study with R1-Distill-Qwen-1.5B, learned spans continue to outperform matched random spans (median Delta=0.409, 355/500 positive; p=2.3e-21), and curvature-impact co-localizes with DRTC within traces as a diagnostic. We benchmark against gradient- and perturbation-based chunk attributions and show graded outcome linkage: under embedding-interpolation edits, top-ranked DRTC chunks reduce teacher-forced gold-answer log-probability more than strict position-matched random chunks on a stability-filtered subset. Overall, DRTC provides a causally grounded view of how specific context elements steer on-policy reasoning trajectories.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 31 of its 33 references that are in the map. First posted on arXiv 17 Feb 2026.

Builds on

31 of 33 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Towards Long-Horizon Interpretability: Efficient and Faithful Multi-Token Attribution for Reasoning LLMs2 Feb
  2. 2025Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention15 Oct
  3. 2025Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppression7 Aug
  4. 2025Entropy-Gated Branching for Efficient Test-Time Reasoning27 Mar
  5. 2025DeLTa: A Decoding Strategy based on Logit Trajectory Prediction Improves Factuality and Reasoning Ability4 Mar

Other references · 26

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  4. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  5. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  6. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 530
  7. 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
  8. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 359
  9. 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 259
  10. 2016Understanding Neural Networks through Representation Erasurecited by 224
  11. 2019Pay Less Attention with Lightweight and Dynamic Convolutionscited by 211
  12. 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 129
14 more
  1. 2023Deductive Verification of Chain-of-Thought Reasoningcited by 124
  2. 2026Ministral 3cited by 114
  3. 2025When Chain of Thought is Necessary, Language Models Struggle to Evade Monitorscited by 88
  4. 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
  5. 2025Phi-4-Mini-Reasoning: Exploring the Limits of Small Reasoning Language Models in Mathcited by 44
  6. 2025LFM2 Technical Reportcited by 37
  7. 2025The Geometry of Reasoning: Flowing Logics in Representation Spacecited by 21
  8. 2025Thought Branches: Interpreting LLM Reasoning Requires Resamplingcited by 16
  9. 2025Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thoughtcited by 15
  10. 2026Reasoning Models Generate Societies of Thoughtcited by 12
  11. 2025Curved Inference: Concern-Sensitive Geometry in Large Language Model Residual Streamscited by 6
  12. 2025Addition in Four Movements: Mapping Layer-wise Information Trajectories in LLMscited by 4
  13. 2025Explaining the Reasoning of Large Language Models Using Attribution Graphscited by 3
  14. 2025Cautious Next Token Predictioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reasoning Models Don't Just Think Longer, They Move Differently
  2. 2026LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals
  3. 2026Invariant Reasoning Directions in Latent Trajectories of Language Models
  4. 2026How Hard Does It Think? Analyzing Step-Aware Reasoning Energy in LLM Chain-of-Thought Trajectories
  5. 2026Geometry of Divergence: Tracking Hidden-State Trajectories for Adaptive Multi-Turn Reasoning
  6. 2026Answer-Distribution Trajectories: A Stochastic-Dynamics View of LLM Reasoning
  7. 2025Efficient Thought Space Exploration Through Strategic Intervention
  8. 2025Tracing the Traces: Latent Temporal Signals for Efficient and Accurate Reasoning