Decomposing LLM Self-Correction: The Accuracy-Correction Paradox and Error Depth Hypothesis
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are widely believed to possess self-correction capabilities, yet recent studies suggest that intrinsic self-correction--where models correct their own outputs without external feedback--remains largely ineffective. In this work, we systematically decompose self-correction into three distinct sub-capabilities: error detection, error localization, and error correction. Through cross-model experiments on GSM8K-Complex (n=500 per model, 346 total errors) with three major LLMs, we uncover a striking Accuracy-Correction Paradox: weaker models (GPT-3.5, 66% accuracy) achieve 1.6x higher intrinsic correction rates than stronger models (DeepSeek, 94% accuracy)--26.8% vs 16.7%. We propose the Error Depth Hypothesis: stronger models make fewer but deeper errors that resist self-correction. Error detection rates vary dramatically across architectures (10% to 82%), yet detection capability does not predict correction success--Claude detects only 10% of errors but corrects 29% intrinsically. Surprisingly, providing error location hints hurts all models. Our findings challenge linear assumptions about model capability and self-improvement, with important implications for the design of self-refinement pipelines.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 5 of its 8 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
5 of 8 references.
References · 5
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 11
- 2026Precise but Uncoupled: Reviewer Precision Does Not Guarantee Critique Uptake in Multi-Agent Math Reasoningcited by 2
- 2026From Hallucination to Structure Snowballing: The Alignment Tax of Constrained Decoding in LLM Reflectioncited by 1
- 2026It's Not the Capability: Harness Sensitivity Is Non-Monotone Across LLM Agent Tierscited by 1
- 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agentscited by 1
- 2026ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detectioncited by 0
- 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generationcited by 0
- 2026Why Didn't It Check? Unsupported Final Claims and Their Repair in Two Tool-Equipped Language Modelscited by 0
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement10 Sep 2026
- 2026Why Didn't It Check? Unsupported Final Claims and Their Repair in Two Tool-Equipped Language Models27 Aug 2026
- 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents7 Aug 2026
- 2026Precise but Uncoupled: Reviewer Precision Does Not Guarantee Critique Uptake in Multi-Agent Math Reasoning16 Jul 2026
- 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generation9 Jul 2026
- 2026It's Not the Capability: Harness Sensitivity Is Non-Monotone Across LLM Agent Tiers26 May 2026
- 2026ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection20 May 2026
- 2026From Hallucination to Structure Snowballing: The Alignment Tax of Constrained Decoding in LLM Reflection7 Apr 2026