ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning and efficiency without updating model parameters. However, most existing approaches rely on fixed steering policies and static intervention strengths, which limit their robustness across problem instances and often result in over- or under-steering. We propose Adaptive Test-time Latent Steering (ATLAS), a lightweight framework that dynamically controls steering decisions at inference time using a trained, lightweight verifier over the latent states. Given intermediate hidden states, the verifier predicts the quality of ongoing reasoning and adaptively selects which steering action to apply, enabling per-example and per-step adjustment with minimal overhead. ATLAS provides a unified framework for combining learned latent verification with test-time activation steering, enabling adaptive reasoning control without additional LLM decoding or inference-time process reward model calls. Experiments on multiple mathematical and coding reasoning benchmarks show that ATLAS consistently outperforms both vanilla decoding and fixed steering baselines, achieving higher accuracy while substantially reducing test-time token usage. These results demonstrate that verifier-guided latent adaptation provides an effective and scalable mechanism for controlling reasoning efficiency without sacrificing solution quality. All source code will be publicly available.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 17 of its 45 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
17 of 45 references.
Closest ancestors · 4
Same direction, newest first
- 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time31 Dec
- 2025A Survey on Latent Reasoning8 Jul
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
Other references · 13
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
- 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Modelscited by 65
- 2025Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stagescited by 13
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026AMPS: Adaptive Modality Preference Steering via Functional Entropycited by 4
- 2026Adversarial Robustness of Activation Steering in Large Language Modelscited by 1
- 2026LLM Reasoning Is Latent, Not the Chain of Thoughtcited by 0
- 2026Steering Recurrent Reasoners at Inference Time with Readout Feedbackcited by 0
- 2026Replay-Gated Neural Execution: Decoupling Persistent Behavioral Specifications from Neural Realizations in Frozen Language Modelscited by 0
- 2026Efficient Reasoning via Constrained Optimization in Latent Spacecited by 0
- 2026Efficient Reasoning via Constrained Optimization in Latent Space28 Sep 2026
- 2026Replay-Gated Neural Execution: Decoupling Persistent Behavioral Specifications from Neural Realizations in Frozen Language Models5 Sep 2026
- 2026Steering Recurrent Reasoners at Inference Time with Readout Feedback25 Aug 2026
- 2026Adversarial Robustness of Activation Steering in Large Language Models5 Jun 2026
- 2026LLM Reasoning Is Latent, Not the Chain of Thought17 Apr 2026
- 2026AMPS: Adaptive Modality Preference Steering via Functional Entropy13 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Prototype-Based Dynamic Steering for Large Language Models
- 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
- 2025Adaptive Activation Steering for Efficient LLM Reasoning via Closed-Loop PID Control
- 2026RISER: Orchestrating Latent Reasoning Skills for Adaptive Activation Steering
- 2026Identifying and Transferring Reasoning-Critical Neurons: Improving LLM Inference Reliability via Activation Steering
- 2025Learning to Ponder: Adaptive Reasoning in Latent Space
- 2026COMPASS: Finding Where Reasoning Lives in Language Models
- 2025Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention