mlsanityData to 14 Oct 2026

How Language Models Fail: Token-Level Signatures of Committed and Persistent Reasoning Failures

arXiv 2606.06635 ↗First posted 4 Jun 2026cs.CL cs.AIcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Failures in language model reasoning emerge through distinct processes that leave identifiable signatures in the reasoning trace. We characterize these failures using token-level uncertainty signals, finding they arise through two empirically distinguishable processes. The first is committed failure, in which a model locks onto an incorrect reasoning path early in its trace. A central diagnostic signature is the commitment point, beyond which considering additional tokens hurt rather than help failure detection. In the second, persistent uncertainty, uncertainty instead accumulates throughout, and the full trace is needed to best distinguish failing from successful completions. These signatures reproduce across 23 model-dataset configurations, with the framework's falsifiable predictions holding in 20 of 23 cases, well above chance across both failure modes. Finally, we demonstrate our failure mode framework has direct implications for self-consistency, identifying when uncertainty signals complement it and when it can be selectively skipped. These results offer a foundation for understanding when LLM reasoning failures become detectable and for adapting detection strategies accordingly.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 32 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

15 of 32 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Entropy trajectory shape predicts LLM reasoning reliability: A diagnostic study of uncertainty dynamics in chain-of-thought19 Mar
  2. 2025Trace Length is a Simple Uncertainty Signal in Reasoning Models12 Oct
  3. 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
  4. 2022Language Models (Mostly) Know What They Know11 Jul

Other references · 11

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
  6. 2026Qwen3.5-Omni Technical Reportcited by 174
  7. 2021AR-LSAT: Investigating Analytical Reasoning of Textcited by 51
  8. 2026Reasoning Theater: Disentangling Model Beliefs from Chain-of-Thoughtcited by 40
  9. 2025LLM Probability Concentration: How Alignment Shrinks the Generative Horizoncited by 26
  10. 2025Are language models aware of the road not taken? Token-level uncertainty and hidden state dynamicscited by 11
  11. 2026Why Models Know But Don't Say: Chain-of-Thought Faithfulness Divergence Between Thinking Tokens and Answers in Open-Weight Reasoning Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Dissecting Failure Dynamics in Large Language Model Reasoning
  2. 2026"I May Not Have Articulated Myself Clearly": Diagnosing Dynamic Instability in LLM Reasoning at Inference Time
  3. 2026Large Language Model Reasoning Failures
  4. 2026Cliff Tokens: Identifying Single-Token Failure Triggers in LLM Mathematical Reasoning
  5. 2026Understanding LLM Failures: A Multi-Tape Turing Machine Analysis of Systematic Errors in Language Model Reasoning
  6. 2026Contextual Drag: How Errors in the Context Affect LLM Reasoning
  7. 2026Tracing Uncertainty in Language Model "Reasoning"
  8. 2026Failed Reasoning Traces Tell You What Is Fixable (But Not by Reading Them)