The Self-Correction Illusion: Role Relabeling Gates Explicit Error Flagging in Large Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
Recent works show that LLM agents struggle to correct errors in their own reasoning traces, despite their ability to correct errors from external sources. We ask whether this reflects a capability deficit or an artifact of the role labeling. To test this, we design a training-free intervention, source-conditioned role relabeling, that keeps the erroneous claim byte-identical and varies only its message role. The claim is presented inside the agent's "<thought>", a user message, a tool response, or a system "<memory>" block. We test 12 model-domain combinations spanning closed-weight APIs and open-weight models from 70B-class down to smaller families. Relabeling "<thought>" to an external role increases the explicit-correction rate by 23 to 93 percentage points, significant in 10 of 12 experimental settings. This suggests that these models' failure to detect a self-generated error is largely an artifact of how the claim is role-labeled in the chat template, rather than a pure cognitive deficit. The most effective role label is domain-dependent: "<memory>" dominates in most math experiments, while a user message dominates in logical deduction. Recognizing role-label handling as a key experimental variable in instruction tuning presents a more direct path to closing the self-correction gap.d
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 22 of its 38 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
22 of 38 references.
Closest ancestors · 3
Same direction, newest first
- 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
- 2025Boosting LLM Reasoning via Spontaneous Self-Correction7 Jun
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing19 May
Other references · 19
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2025Reasoning Models Don't Always Say What They Thinkcited by 388
7 more
- 2022Generating Sequences by Learning to Self-Correctcited by 271
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
- 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 186
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 127
- 2025A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memorycited by 61
- 2025Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzlescited by 53
- 2025The Reasoning Trap: How Enhancing LLM Reasoning Amplifies Tool Hallucinationcited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Self-Correction Bench: Uncovering and Addressing the Self-Correction Blind Spot in Large Language Models
- 2025Probing for Arithmetic Errors in Language Models
- 2025Language Models can perform Single-Utterance Self-Correction of Perturbed Reasoning
- 2025Self-Correcting Large Language Models: Generation vs. Multiple Choice
- 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoning
- 2025Synthetic Error Injection Fails to Elicit Self-Correction In Language Models
- 2023Self-Refine: Iterative Refinement with Self-Feedback
- 2026Structure Enables Effective Self-Localization of Errors in LLMs