mlsanityData to 14 Oct 2026

"I May Not Have Articulated Myself Clearly": Diagnosing Dynamic Instability in LLM Reasoning at Inference Time

arXiv 2602.02863 ↗First posted 2 Feb 2026cs.AI cs.LGcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Reasoning failures in large language models (LLMs) are typically measured only at the end of a generation, yet many failures manifest as a process-level breakdown: the model "loses the thread" mid-reasoning. We study whether such breakdowns are detectable from inference-time observables available in standard APIs (token log probabilities), without any training or fine-tuning. We define a simple instability signal that combines consecutive-step distributional shift (JSD) and uncertainty (entropy), summarize each trace by its peak instability strength, and show that this signal reliably predicts failure. Across GSM8K and HotpotQA, instability strength predicts wrong answers with above-chance AUC and yields monotonic bucket-level accuracy decline at scale across model sizes. Crucially, we show that instability is not uniformly harmful: early instability can reflect subsequent stabilization and a correct final answer (corrective instability), whereas late instability is more often followed by failure (destructive instability), even at comparable peak magnitudes, indicating that recoverability depends not only on how strongly the distribution changes but also on when such changes occur relative to the remaining decoding horizon. The method is model-agnostic, training-free, and reproducible, and is presented as a diagnostic lens rather than a corrective or control mechanism.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 37 of its 46 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

37 of 46 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Training Language Models to Self-Correct via Reinforcement Learning19 Sep
  2. 2024Large Language Models have Intrinsic Self-Correction Ability21 Jun
  3. 2023LLMs cannot find reasoning errors, but can correct them given the error location14 Nov
  4. 2023Large Language Models Cannot Self-Correct Reasoning Yet3 Oct
  5. 2022Language Models (Mostly) Know What They Know11 Jul

Other references · 32

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2017On Calibration of Modern Neural Networkscited by 4,960
  8. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  9. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  10. 2023Let's Verify Step by Stepcited by 3,789
  11. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  12. 2024Qwen2 Technical Reportcited by 2,120
20 more
  1. 2022In-context Learning and Induction Headscited by 964
  2. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  3. 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
  4. 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
  5. 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
  6. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 217
  7. 2024Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similaritiescited by 159
  8. 2025Process Reward Models That Thinkcited by 118
  9. 2024Multicalibration for Confidence Scoring in LLMscited by 46
  10. 2024Detecting Hallucinations in Large Language Model Generation: A Token Probability Approachcited by 42
  11. 2025Understanding the Uncertainty of LLM Explanations: A Perspective Based on Reasoning Topologycited by 25
  12. 2025Robust Hallucination Detection in LLMs via Adaptive Token Selectioncited by 19
  13. 2025Semantic Energy: Detecting LLM Hallucination Beyond Entropycited by 18
  14. 2025Temporal Consistency for LLM Reasoning Process Error Identificationcited by 10
  15. 2024Stepwise Reasoning Error Disruption Attack of LLMscited by 8
  16. 2024Unveiling and Manipulating Prompt Influence in Large Language Modelscited by 6
  17. 2025ReasonGraph: Visualisation of Reasoning Pathscited by 6
  18. 2025Hallucination Detection on a Budget: Efficient Bayesian Estimation of Semantic Entropycited by 5
  19. 2024Self-correction is Not An Innate Capability in Language Modelscited by 2
  20. 2025Detecting Token-Level Hallucinations Using Variance Signals: A Reference-Free Approachcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Dissecting Failure Dynamics in Large Language Model Reasoning
  2. 2026EDIS: Diagnosing LLM Reasoning via Entropy Dynamics
  3. 2026Wrong Prediction, Right Answer: Recovering Evidence from Collapsed LLM Sequence Scores
  4. 2026How Language Models Fail: Token-Level Signatures of Committed and Persistent Reasoning Failures
  5. 2026Silent Failures in Quantized LLM Reasoning: A Taxonomy-Based Analysis of Hollow Convergence and Failure Mode Shifts
  6. 2026Fragile Reasoning: A Mechanistic Analysis of LLM Sensitivity to Meaning-Preserving Perturbations
  7. 2026Beyond Confidence: Stability-Aware Test-Time Adaptation for LLM Reasoning
  8. 2025Not All Errors Are Created Equal: ASCoT Addresses Late-Stage Fragility in Efficient LLM Reasoning