mlsanityData to 14 Oct 2026

Reasoning Stabilization Point: A Training-Time Signal for Stable Evidence and Shortcut Reliance

arXiv 2601.11625 ↗First posted 12 Jan 2026cs.AI cs.LGcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Fine-tuning pretrained language models can improve task performance while subtly altering the evidence a model relies on. We propose a training-time interpretability view that tracks token-level attributions across finetuning epochs. We define explanation driftas the epoch-to-epoch change in normalized token attributions on a fixed probe set, and introduce the Reasoning Stabilization Point(RSP), the earliest epoch after which drift remains consistently low. RSP is computed from within-run drift dynamics and requires no tuning on out-of-distribution data. Across multiple lightweight transformer classifiers and benchmark classification tasks, drift typically collapses into a low, stable regime early in training, while validation accuracy continues to change only marginally. In a controlled shortcut setting with label-correlated trigger tokens, attribution dynamics expose increasing reliance on the shortcut even when validation accuracy remains competitive. Overall, explanation drift provides a simple, low-cost diagnostic for monitoring how decision evidence evolves during fine-tuning and for selecting checkpoints in a stable-evidence regime.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 23 of its 28 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

23 of 28 references.

References · 23

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  4. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  7. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  8. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  9. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  10. 2018Sanity Checks for Saliency Mapscited by 1,156
  11. 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
  12. 2019Attention is not Explanationcited by 929
11 more
  1. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
  2. 2018Annotation Artifacts in Natural Language Inference Datacited by 671
  3. 2019Attention is not not Explanationcited by 636
  4. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 530
  5. 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
  6. 2019Is Attention Interpretable?cited by 389
  7. 2018Hypothesis Only Baselines in Natural Language Inferencecited by 295
  8. 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 214
  9. 2015Visualizing and Understanding Neural Models in NLPcited by 200
  10. 2018Breaking NLI Systems with Sentences that Require Simple Lexical Inferencescited by 134
  11. 2017Explaining Recurrent Neural Network Predictions in Sentiment Analysiscited by 88

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation
  2. 2026Dissecting Failure Dynamics in Large Language Model Reasoning
  3. 2026EDIS: Diagnosing LLM Reasoning via Entropy Dynamics
  4. 2026Reliable Control-Point Selection for Steering Reasoning in Large Language Models
  5. 2026Confidence Geometry Reveals Trace-Level Correctness in Large Language Model Reasoning
  6. 2025EDIT: Early Diffusion Inference Termination for dLLMs Based on Dynamics of Training Gradients
  7. 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
  8. 2026"I May Not Have Articulated Myself Clearly": Diagnosing Dynamic Instability in LLM Reasoning at Inference Time