mlsanityData to 14 Oct 2026

Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction

arXiv 2610.13672 ↗First posted 9 Oct 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking also fits: Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models struggle to reliably identify and correct errors in their own reasoning. Unlike prior training-based approaches that fine-tune an LLM to generate revisions or feedback, we learn where to intervene in failed rollouts and determine how to redirect them. To choose where to intervene, we train a 130K-parameter MLP head on a frozen encoder using only final-answer correctness. For redirection, we find that under a fixed generation budget, the tested inline injections fail to reliably redirect reasoning, whereas presenting the same instruction in a new user turn changes the model's course. The resulting correction framework, UPTURN (User-Prompt TURN injection at a learned position), requires no LLM fine-tuning: it retains a selected prefix, injects an instruction as a new user turn, and regenerates the suffix. Across four reasoners and six math benchmarks, UPTURN improves average accuracy in every setting over a 32-rollout baseline. It outperforms self-correction and reflection-token injection baselines under matched correction budgets, transfers across reasoners and to GPQA-Diamond without retraining, and complements GRPO and self-correction methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 21 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

20 of 21 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Can LLMs Correct Themselves? A Benchmark of Self-Correction in LLMs17 Oct
  2. 2025Learning a Continue-Thinking Token for Enhanced Test-Time Scaling12 Jun
  3. 2025CyclicReflex: Improving Reasoning Models via Cyclical Reflection Token Scheduling4 Jun
  4. 2025AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time30 May
  5. 2025s1: Simple test-time scaling31 Jan
  6. 2024Training Language Models to Self-Correct via Reinforcement Learning19 Sep
  7. 2023Large Language Models Cannot Self-Correct Reasoning Yet3 Oct
  8. 2023REFINER: Reasoning Feedback on Intermediate Representations4 Apr
  9. 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar

Other references · 11

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Let's Verify Step by Stepcited by 3,789
  7. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  8. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  9. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  10. 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 559
  11. 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improvecited by 165

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023LLMs cannot find reasoning errors, but can correct them given the error location
  2. 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoning
  3. 2025PAG: Multi-Turn Reinforced LLM Self-Correction with Policy as Generative Verifier
  4. 2023Learning From Mistakes Makes LLM Better Reasoner
  5. 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
  6. 2026REVES: REvision and VErification--Augmented Training for Test-Time Scaling
  7. 2026Reinforcing Step-level Reasoning for Effective Self-Correction in LLMs
  8. 2024Learning to Check: Unleashing Potentials for Self-Correction in Large Language Models