Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Extended reasoning has become standard for frontier Large Language Models (LLMs), yet the trajectories these models produce remain largely uncontrollable. Existing methods for shaping how a model reasons are prompt based approaches and operate at the input level, offering no fine-grained control over the reasoning process itself. Related work analyzes and discovers latent transition dynamics in the reasoning traces from Large Language Models. Building on this, we statistically characterize these states, and show that failure trajectories get stuck in self-loops, exhausting the token budget without progress toward the final answer. To intervene on these failures, We propose SOPHIA: Steering Of reasoning Processes via Hidden-state Intervention and Activations. We treat each reasoning trace as a sequence of latent states rather than an unstructured texts, and investigate whether inference time interventions can provide fine-grained control over the self-looping reasoning process. We classify every prefix to a latent state, record step level transitions, and use them to construct a bank of steering vectors indexed by state pairs. At inference time, a controller infers the current state and, given a target state, retrieves the corresponding vector and can also detect self-loops online from the transition structure to prevent the model from sinking into a reasoning black hole. Through extensive experiments, our method reliably intervenes on self-loop failures, with steering vectors that generalize to different state pairs. End task accuracy and token efficiency indicate that fine-grained controllability results in better reasoning quality.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 28 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
15 of 28 references.
Closest ancestors · 5
Same direction, newest first
- 2025SmartSwitch: Advancing LLM Reasoning by Overcoming Underthinking via Promoting Deeper Thought Exploration22 Oct
- 2025CTRLS: Chain-of-Thought Reasoning via Latent State-Transition10 Jul
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
- 2024Efficiently Scaling LLM Reasoning with Certaindex30 Dec
- 2024Training Language Models to Self-Correct via Reinforcement Learning19 Sep
Other references · 10
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
- 2026Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learningcited by 8
- 2026AMPS: Adaptive Modality Preference Steering via Functional Entropycited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026State of Thought Enables Endogenous Reasoning
- 2026A Mechanistic Analysis of Looped Reasoning Language Models
- 2025Implicit Reasoning in Large Language Models: A Comprehensive Survey
- 2026LLM Reasoning Is Latent, Not the Chain of Thought
- 2025Dancing with Critiques: Enhancing LLM Reasoning with Stepwise Natural Language Self-Critique
- 2025Beyond Chains of Thought: Benchmarking Latent-Space Reasoning Abilities in Large Language Models
- 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
- 2026Dissecting Failure Dynamics in Large Language Model Reasoning