mlsanityData to 14 Oct 2026

Self-Anchoring Calibration Drift in Large Language Models: How Multi-Turn Conversations Reshape Model Confidence

arXiv 2603.01239 ↗First posted 1 Mar 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce Self-Anchoring Calibration Drift (SACD), a hypothesized tendency for large language models (LLMs) to show systematic changes in expressed confidence when building iteratively on their own prior outputs across multi-turn conversations. We report an empirical study comparing three frontier models -- Claude Sonnet 4.6, Gemini 3.1 Pro, and GPT-5.2 -- across 150 questions spanning factual, technical, and open-ended domains, using three conditions: single-turn baseline (A), multi-turn self-anchoring (B), and independent repetition control (C). Results reveal a complex, model-heterogeneous pattern that partially diverges from pre-registered hypotheses. Claude Sonnet 4.6 exhibited significant decreasing confidence under self-anchoring (mean CDS = -0.032, t(14) = -2.43, p = .029, d = -0.627), while also showing significant calibration error drift (F(4,56) = 22.77, p < .001, eta^2 = .791). GPT-5.2 showed the opposite pattern in open-ended domains (mean CDS = +0.026) with significant ECE escalation by Turn 5. Gemini 3.1 Pro showed no significant CDS (t(14) = 0.38, p = .710), but its Condition C data reveals a striking ECE pattern: without self-anchoring, Gemini's calibration error drops from .327 to near zero across repetitions, whereas self-anchoring holds ECE flat at approximately .333 -- indicating that SACD can manifest as suppression of natural calibration improvement rather than ac

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 10 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

7 of 10 references.

References · 7

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  4. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  5. 2022Red Teaming Language Models with Language Modelscited by 1,026
  6. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
  7. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.