Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction
On the map: LLM reasoning → Test-time compute and efficient thinking also fits: Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models struggle to reliably identify and correct errors in their own reasoning. Unlike prior training-based approaches that fine-tune an LLM to generate revisions or feedback, we learn where to intervene in failed rollouts and determine how to redirect them. To choose where to intervene, we train a 130K-parameter MLP head on a frozen encoder using only final-answer correctness. For redirection, we find that under a fixed generation budget, the tested inline injections fail to reliably redirect reasoning, whereas presenting the same instruction in a new user turn changes the model's course. The resulting correction framework, UPTURN (User-Prompt TURN injection at a learned position), requires no LLM fine-tuning: it retains a selected prefix, injects an instruction as a new user turn, and regenerates the suffix. Across four reasoners and six math benchmarks, UPTURN improves average accuracy in every setting over a 32-rollout baseline. It outperforms self-correction and reflection-token injection baselines under matched correction budgets, transfers across reasoners and to GPQA-Diamond without retraining, and complements GRPO and self-correction methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 21 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
20 of 21 references.
Closest ancestors · 9
Same direction, newest first
- 2025Can LLMs Correct Themselves? A Benchmark of Self-Correction in LLMs17 Oct
- 2025Learning a Continue-Thinking Token for Enhanced Test-Time Scaling12 Jun
- 2025CyclicReflex: Improving Reasoning Models via Cyclical Reflection Token Scheduling4 Jun
- 2025AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time30 May
- 2025s1: Simple test-time scaling31 Jan
- 2024Training Language Models to Self-Correct via Reinforcement Learning19 Sep
- 2023Large Language Models Cannot Self-Correct Reasoning Yet3 Oct
- 2023REFINER: Reasoning Feedback on Intermediate Representations4 Apr
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
Other references · 11
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Let's Verify Step by Stepcited by 3,789
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 559
- 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improvecited by 165
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023LLMs cannot find reasoning errors, but can correct them given the error location
- 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoning
- 2025PAG: Multi-Turn Reinforced LLM Self-Correction with Policy as Generative Verifier
- 2023Learning From Mistakes Makes LLM Better Reasoner
- 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
- 2026REVES: REvision and VErification--Augmented Training for Test-Time Scaling
- 2026Reinforcing Step-level Reasoning for Effective Self-Correction in LLMs
- 2024Learning to Check: Unleashing Potentials for Self-Correction in Large Language Models