Self-Anchoring Calibration Drift in Large Language Models: How Multi-Turn Conversations Reshape Model Confidence
Not on the map. Why?
Abstract (arXiv)
We introduce Self-Anchoring Calibration Drift (SACD), a hypothesized tendency for large language models (LLMs) to show systematic changes in expressed confidence when building iteratively on their own prior outputs across multi-turn conversations. We report an empirical study comparing three frontier models -- Claude Sonnet 4.6, Gemini 3.1 Pro, and GPT-5.2 -- across 150 questions spanning factual, technical, and open-ended domains, using three conditions: single-turn baseline (A), multi-turn self-anchoring (B), and independent repetition control (C). Results reveal a complex, model-heterogeneous pattern that partially diverges from pre-registered hypotheses. Claude Sonnet 4.6 exhibited significant decreasing confidence under self-anchoring (mean CDS = -0.032, t(14) = -2.43, p = .029, d = -0.627), while also showing significant calibration error drift (F(4,56) = 22.77, p < .001, eta^2 = .791). GPT-5.2 showed the opposite pattern in open-ended domains (mean CDS = +0.026) with significant ECE escalation by Turn 5. Gemini 3.1 Pro showed no significant CDS (t(14) = 0.38, p = .710), but its Condition C data reveals a striking ECE pattern: without self-anchoring, Gemini's calibration error drops from .327 to near zero across repetitions, whereas self-anchoring holds ECE flat at approximately .333 -- indicating that SACD can manifest as suppression of natural calibration improvement rather than ac
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 10 references that are in the map. First posted on arXiv 1 Mar 2026.
Builds on
7 of 10 references.
References · 7
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
Built on by
Citing papers per year: 2026: 1.
1 paper.