mlsanityData to 14 Oct 2026

Confidence Geometry Reveals Trace-Level Correctness in Large Language Model Reasoning

arXiv 2605.16824 ↗First posted 16 May 2026cs.LG cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models (LLMs) generate not only reasoning text, but also token-level confidence trajectories that record how uncertainty evolves during inference. Whether these trajectories are relevant to reasoning correctness remains unclear. Here we show that confidence trajectories encode a content-agnostic confidence geometry associated with trace-level final-answer correctness. Using only token-level confidence values, without access to the input question, reasoning text, hidden states, or external verifiers, we find that low-dimensional representations of confidence trajectories separate correct from incorrect reasoning traces. Across GSM8K, MATH, and MMLU, this geometric separation is quantitatively linked to downstream predictability: stronger clustering of correct and incorrect traces, measured by the Davies--Bouldin index, consistently corresponds to higher correctness-discrimination AUC. We further show that correctness-related information is enriched in the tail of reasoning, suggesting that late-stage confidence dynamics carry key correctness signals. We propose NeuralConf, a lightweight estimator that learns from confidence trajectories for correctness evaluation. Under a fixed trace budget, NeuralConf-derived scores improve confidence-weighted answer aggregation over majority voting, tail confidence, and other static baselines. These results reveal that LLMs expose trace-intrinsic statistical signals of correctness through their own confidence dynamics, offering a route to improve inference using information already present within generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 26 of its 31 references that are in the map. First posted on arXiv 16 May 2026.

Builds on

26 of 31 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Deep Think with Confidence21 Aug
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
  3. 2023Self-Evaluation Guided Beam Search for Reasoning1 May
  4. 2022Language Models (Mostly) Know What They Know11 Jul

Other references · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  8. 2024Qwen2.5 Technical Reportcited by 4,942
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  10. 2023Let's Verify Step by Stepcited by 3,789
  11. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  12. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
10 more
  1. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  2. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  3. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  4. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
  5. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  6. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  7. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
  8. 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
  9. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 217
  10. 2024A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chainscited by 65

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Confidence Manifold: Geometric Structure of Correctness Representations in Language Models
  2. 2026Closing the Confidence-Faithfulness Gap in Large Language Models
  3. 2026Quantifying Faithful Confidence Expression in Large Reasoning Models
  4. 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
  5. 2026Post-Training Shifts Confidence: A Three-Stage Analysis of How SFT, RL, and OPD Shape CoT Calibration
  6. 2025Trace Length is a Simple Uncertainty Signal in Reasoning Models
  7. 2026Understanding and Mitigating Premature Confidence for Better LLM Reasoning
  8. 2026Probability is Not Enough: Exploring and Counting Divergent Tokens for Reasoning Uncertainty Quantification in LLMs