mlsanityData to 14 Oct 2026

Reported Confidence in LLMs Tracks Commitment More Than Correctness

arXiv 2606.29490 ↗First posted 28 Jun 2026cs.LG cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Confidence is an estimate of the probability that a chosen answer is correct. Verbal confidence reports are widely used as uncertainty measures in large language models, but whether they are best understood as estimates of correctness is unclear. We test this with a two-stage abstention paradigm from the neuroscience of perceptual decision making: a model first answers and reports its confidence, then decides whether to commit it to a user or abstain. Across four non-reasoning models, prompt framings, and confidence formats, verbal confidence predicted the commit/abstain decision substantially better than whether the answer was correct. Calibrated token log-probabilities showed the opposite profile, with abstention-prediction coupled to correctness discrimination, the signature of an answer-evidence signal. After removing the variance verbal confidence shared with log-probabilities, the residual stayed aligned with commitment while its link to correctness fell to near chance. The dissociation generalised to four reasoning models across four benchmarks of varying difficulty, from hard multiple-choice to frontier-level freeform questions. Mechanistic analyses in Gemma 3 and 4 were convergent: a post-answer state known to causally support verbal-confidence generation already encoded the future abstention decision before the abstention prompt, organised mainly by that decision rather than by correctness, the two lying in approximately orthogonal directions in activation space. Steering along a verbal-confidence-specific direction causally shifted abstention. Verbal and log-probability confidence are thus not interchangeable: log-probabilities track answer evidence and correctness, whereas verbal confidence is better understood as a behaviour-facing readout of an internal commit-readiness state, challenging the practice of treating verbal reports as proxies for reliability.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 13 of its 39 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

13 of 39 references.

References · 13

  1. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  2. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  3. 2023Steering Language Models With Activation Engineeringcited by 922
  4. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
  5. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  6. 2024Measuring short-form factuality in large language modelscited by 373
  7. 2025Deep Think with Confidencecited by 205
  8. 2026Emergent Introspective Awareness in Large Language Modelscited by 82
  9. 2025SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplinescited by 79
  10. 2025Reasoning Models Better Express Their Confidencecited by 65
  11. 2026How do LLMs Compute Verbal Confidencecited by 26
  12. 2026Causal Evidence that Language Models use Confidence to Drive Behaviorcited by 10
1 more
  1. 2026Mechanisms of Introspective Awarenesscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Confidence in the Reasoning of Large Language Models
  2. 2026An Analysis of Training-Free Self-Reported Confidence in Language Models
  3. 2026LLMs Should Express Uncertainty Explicitly
  4. 2026Certainty Is Not Just Correctness: Rethinking Token-Level Certainty in LLM Reasoning
  5. 2026CALIBER: Calibrating Confidence Before and After Reasoning in Language Models
  6. 2024Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language Models
  7. 2025Let the Model Distribute Its Doubt: Confidence Estimation through Verbalized Probability Distribution
  8. 2026Understanding and Mitigating Premature Confidence for Better LLM Reasoning