The Halt Vector: Internalizing a Causal Steering Intervention for Efficient Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Reasoning models do not stop when they know the answer. On DeepSeek-R1-Distill-Qwen-7B the chain of thought runs about twice as long as the model's own answer probability takes to settle, and how much of that excess is removable varies from problem to problem, so a global length penalty cannot take it out. We take it out by internalizing a causal interpretability finding into the weights. The mechanism is a halt vector: a difference-of-means direction at layer 18 of this model whose steering strength controls how long it thinks, while a replicated value axis does nothing. Installing that intervention in the weights is harder than it looks. Maximizing the scalar projection onto the direction corrupts the off-axis dimensions a frozen downstream reader depends on, and generation gets longer instead of shorter; what works is reconstructing the whole steered activation with those dimensions pinned to their natural values. Fit from 24 problems and no reinforcement learning, the halt removes about a quarter of the thinking at held accuracy across five unseen benchmarks, and the cut tracks each problem's own removable slack at 0.70. It also closes a non-termination pathology that grows with difficulty and that a decoding-time confidence hook makes worse. We do not claim to beat a well-tuned length penalty or decoding-time early exit on the raw trade-off; the contribution is how the halt is obtained.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 24 of its 29 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
24 of 29 references.
Closest ancestors · 7
Same direction, newest first
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verification7 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025s1: Simple test-time scaling31 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
Other references · 17
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2025Training Language Models to Reason Efficientlycited by 247
5 more
- 2025Calibrating Verbal Uncertainty as a Linear Feature to Reduce Hallucinationscited by 48
- 2025Knowing Before Saying: LLM Representations Encode Information About Chain-of-Thought Success Before Completioncited by 23
- 2025Steering Language Models with Weight Arithmeticcited by 20
- 2026The Value Axis: Language Models Encode Whether They're on the Right Trackcited by 7
- 2026How's it going? Reinforcement learning in language models recruits a functional welfare axiscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Small Vectors, Big Effects: A Mechanistic Study of RL-Induced Reasoning via Steering Vectors
- 2025Understanding Reasoning in Thinking Language Models via Steering Vectors
- 2026On the Generalization of Steering Vectors for Chain-of-Thought Faithfulness
- 2026Reliable Control-Point Selection for Steering Reasoning in Large Language Models
- 2026Decoding the Critique Mechanism in Large Reasoning Models
- 2025TempoBench: Reasoning Execution Without Causal Attribution Is Just Simulation
- 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?
- 2025Steering LLM Reasoning Through Bias-Only Adaptation