mlsanityData to 7 Oct 2026

ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoning

arXiv 2601.03093 ↗First posted 6 Jan 2026cs.LG cs.CLcited by 6

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning and efficiency without updating model parameters. However, most existing approaches rely on fixed steering policies and static intervention strengths, which limit their robustness across problem instances and often result in over- or under-steering. We propose Adaptive Test-time Latent Steering (ATLAS), a lightweight framework that dynamically controls steering decisions at inference time using a trained, lightweight verifier over the latent states. Given intermediate hidden states, the verifier predicts the quality of ongoing reasoning and adaptively selects which steering action to apply, enabling per-example and per-step adjustment with minimal overhead. ATLAS provides a unified framework for combining learned latent verification with test-time activation steering, enabling adaptive reasoning control without additional LLM decoding or inference-time process reward model calls. Experiments on multiple mathematical and coding reasoning benchmarks show that ATLAS consistently outperforms both vanilla decoding and fixed steering baselines, achieving higher accuracy while substantially reducing test-time token usage. These results demonstrate that verifier-guided latent adaptation provides an effective and scalable mechanism for controlling reasoning efficiency without sacrificing solution quality. All source code will be publicly available.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 17 of its 45 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

17 of 45 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time31 Dec
  2. 2025A Survey on Latent Reasoning8 Jul
  3. 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
  4. 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan

Other references · 13

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2024Qwen2 Technical Reportcited by 2,076
  4. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  5. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  6. 2023Steering Language Models With Activation Engineeringcited by 824
  7. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  8. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
  9. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
  10. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
  11. 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Modelscited by 65
  12. 2025Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stagescited by 13
1 more
  1. 2025What Defines Good Reasoning in LLMs? Dissecting Reasoning Steps with Multi-Aspect Evaluationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Prototype-Based Dynamic Steering for Large Language Models
  2. 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
  3. 2025Adaptive Activation Steering for Efficient LLM Reasoning via Closed-Loop PID Control
  4. 2026RISER: Orchestrating Latent Reasoning Skills for Adaptive Activation Steering
  5. 2026Identifying and Transferring Reasoning-Critical Neurons: Improving LLM Inference Reliability via Activation Steering
  6. 2025Learning to Ponder: Adaptive Reasoning in Latent Space
  7. 2026COMPASS: Finding Where Reasoning Lives in Language Models
  8. 2025Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention