Internal Reasoning vs. External Control: A Thermodynamic Analysis of Sycophancy in Large Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Language Models exhibit sycophancy: prioritizing agreeableness over correctness. Current remedies evaluate reasoning outcomes: RLHF rewards correct answers, self-correction critiques outputs. All require ground truth, which is often unavailable at inference time and vulnerable to the same biases. We explore evaluating the reasoning process instead. Regulated Causal Anchoring (RCA) verifies whether outputs follow from their reasoning traces, without requiring ground truth. Sycophancy manifests as trace-output inconsistency: models derive one answer but output another to please users. RCA detects this inconsistency, achieving 0.0% sycophancy while accepting 88% of valid hints. We identify two failures invisible to outcome evaluation: Inverse Scaling (frontier models sycophant more because rationalization requires capability) and the Final Output Gap (correct reasoning precedes sycophantic output). Traditional self-correction reduces these failures to 7-9% but cannot eliminate them because the model critiques itself with the same biases. RCA's process evaluation operates at inference time, requires no ground truth, and uses an independent judge that breaks the self-reinforcing bias loop: three properties that outcome evaluation lacks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 22 of its 49 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
22 of 49 references.
Closest ancestors · 1
Same direction, newest first
Other references · 21
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2016Concrete Problems in AI Safetycited by 1,582
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
9 more
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2018AI safety via debatecited by 384
- 2022Self-critiquing models for assisting human evaluatorscited by 372
- 2023AI Control: Improving Safety Despite Intentional Subversioncited by 207
- 2023Inverse Scaling: When Bigger Isn't Bettercited by 205
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
- 2019On the Measure of Intelligencecited by 129
- 2023Eight Things to Know about Large Language Modelscited by 73
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment
- 2026RAudit: A Blind Auditing Protocol for Large Language Model Reasoning
- 2025MONICA: Real-Time Monitoring and Calibration of Chain-of-Thought Sycophancy in Large Reasoning Models
- 2026Agentic Scaffolding Amplifies Sycophantic Behavior in Large Language Models
- 2026When Decodability Is Not Enough: Logical Validity Representations, Behavioral Dissociation, and Causal Tests in Language Models
- 2026Sycophantic Anchors: Localizing and Quantifying User Agreement in Reasoning Models
- 2024Calibrating Reasoning in Language Models with Internal Consistency
- 2026Dissecting Failure Dynamics in Large Language Model Reasoning