RISER: Orchestrating Latent Reasoning Skills for Adaptive Activation Steering
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Recent work on domain-specific reasoning with large language models (LLMs) often relies on training-intensive approaches that require parameter updates. While activation steering has emerged as a parameter efficient alternative, existing methods apply static, manual interventions that fail to adapt to the dynamic nature of complex reasoning. To address this limitation, we propose RISER (Router-based Intervention for Steerable Enhancement of Reasoning), a plug-and-play intervention framework that adaptively steers LLM reasoning in activation space. RISER constructs a library of reusable reasoning vectors and employs a lightweight Router to dynamically compose them for each input. The Router is optimized via reinforcement learning under task-level rewards, activating latent cognitive primitives in an emergent and compositional manner. Across seven diverse benchmarks, RISER yields 3.4-6.5% average zero-shot accuracy improvements over the base model while surpassing CoT-style reasoning with 2-3x higher token efficiency and robust accuracy gains. Further analysis shows that RISER autonomously combines multiple vectors into interpretable, precise control strategies, pointing toward more controllable and efficient LLM reasoning.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 30 of its 63 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
30 of 63 references.
Closest ancestors · 2
Same direction, newest first
- 2025Learning to Ponder: Adaptive Reasoning in Latent Space29 Sep
- 2025Mitigating Content Effects on Reasoning in Language Models through Fine-Grained Activation Steering18 May
Other references · 28
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
16 more
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2024Programming Refusal with Conditional Activation Steeringcited by 191
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2025RL's Razor: Why Online Reinforcement Learning Forgets Lesscited by 162
- 2025Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoningcited by 101
- 2025Steering Large Language Model Activations in Sparse Spacescited by 58
- 2025Base Models Know How to Reason, Thinking Models Learn Whencited by 25
- 2025Enhancing Efficiency and Exploration in Reinforcement Learning for LLMscited by 23
- 2025Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgettingcited by 8
- 2025Probing the Difficulty Perception Mechanism of Large Language Modelscited by 8
- 2025Evaluation of LLMs for mathematical problem solvingcited by 7
- 2025Modular Machine Learning: An Indispensable Path towards New-Generation Large Language Modelscited by 4
- 2025Reasoning Vectors: Transferring Chain-of-Thought Capabilities via Task Arithmeticcited by 4
- 2025Disentangling Recall and Reasoning in Transformer Models through Layer-wise Attention and Activation Analysiscited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Tethered Reasoning: Decoupling Entropy from Hallucination in Quantized LLMs via Manifold Steeringcited by 1
- 2026Latent Reward Steering: An Adaptive Inference-Time Framework that Implicitly Promotes Cognitive Behaviors in Reasoning LLMscited by 0
- 2026Write Back the Delta: Revisiting the Same Tokens with Fresh Representationscited by 0
- 2026Offline Guidance, Online Reasoning: Reusing LLM Feedback for Small Language Modelscited by 0
- 2026Offline Guidance, Online Reasoning: Reusing LLM Feedback for Small Language Models30 Sep 2026
- 2026Write Back the Delta: Revisiting the Same Tokens with Fresh Representations26 Sep 2026
- 2026Latent Reward Steering: An Adaptive Inference-Time Framework that Implicitly Promotes Cognitive Behaviors in Reasoning LLMs30 May 2026
- 2026Tethered Reasoning: Decoupling Entropy from Hallucination in Quantized LLMs via Manifold Steering6 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025AdaReasoner: Adaptive Reasoning Enables More Flexible Thinking in Large Language Models
- 2026Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
- 2026ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoning
- 2025Small Vectors, Big Effects: A Mechanistic Study of RL-Induced Reasoning via Steering Vectors
- 2025Fast Thinking for Large Language Models
- 2026Identifying and Transferring Reasoning-Critical Neurons: Improving LLM Inference Reliability via Activation Steering
- 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering