Steering Large Reasoning Models towards Concise Reasoning via Flow Matching
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
Large Reasoning Models (LRMs) excel at complex reasoning tasks, but their efficiency is often hampered by overly verbose outputs. Prior steering methods attempt to address this issue by applying a single, global vector to hidden representations -- an approach grounded in the restrictive linear representation hypothesis. In this work, we introduce FlowSteer, a nonlinear steering method that goes beyond uniform linear shifts by learning a complete transformation between the distributions associated with verbose and concise reasoning. This transformation is learned via Flow Matching as a velocity field, enabling precise, input-dependent control over the model's reasoning process. By aligning steered representations with the distribution of concise-reasoning activations, FlowSteer yields more compact reasoning than the linear shifts. Across diverse reasoning benchmarks, FlowSteer demonstrates strong task performance and token efficiency compared to leading inference-time baselines. Our work demonstrates that modeling the full distributional transport with generative techniques offers a more effective and principled foundation for controlling LRMs.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 55 of its 68 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
55 of 68 references.
Closest ancestors · 19
Same direction, newest first
- 2025Activation Steering for Chain-of-Thought Compression7 Jul
- 2025Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement18 Jun
- 2025On Reasoning Strength Planning in Large Reasoning Models10 Jun
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
- 2025Overclocking LLM Reasoning: Monitoring and Controlling Thinking Path Lengths in LLMs8 Jun
- 2025Just Enough Thinking: Efficient Reasoning with Adaptive Length Penalties Reinforcement Learning5 Jun
- 2025AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time30 May
- 2025A*-Thought: Efficient Reasoning via Bidirectional Compression for Low-Resource Settings30 May
- 2025Mitigating Overthinking in Large Reasoning Models via Manifold Steering28 May
- 2025Not All Tokens Are What You Need In Thinking23 May
- 2025Thinkless: LLM Learns When to Think19 May
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning8 May
7 more
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
- 2025Self-Training Elicits Concise Reasoning in Large Language Models27 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025s1: Simple test-time scaling31 Jan
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
Other references · 36
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Let's Verify Step by Stepcited by 3,598
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2018Demystifying MMD GANscited by 1,268
24 more
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2024One Step Diffusion via Shortcut Modelscited by 373
- 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 294
- 2024Flow Matching Guide and Codecited by 291
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 286
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
- 2024Massive Activations in Large Language Modelscited by 277
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
- 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
- 2023Bayesian Low-rank Adaptation for Large Language Modelscited by 112
- 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
- 2024Controlling Language and Diffusion Models by Transporting Activationscited by 59
- 2025Steer LLM Latents for Hallucination Detectioncited by 49
- 2025Ada-R1: Hybrid-CoT via Bi-Level Adaptive Reasoning Optimizationcited by 33
- 2021Fine-Grained Neural Network Explanation by Identifying Input Features with Predictive Informationcited by 17
- 2025Calibrating LLMs with Information-Theoretic Evidential Deep Learningcited by 15
- 2025TruthFlow: Truthful LLM Generation via Representation Flow Correctioncited by 14
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Steering LLM Reasoning Through Bias-Only Adaptation
- 2026Flow Reasoning Models: Turning Flows Into Efficient Recurrent Reasoners
- 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection
- 2026Unrolled Flow Models for Reasoning
- 2025Modeling Hierarchical Thinking in Large Reasoning Models
- 2025Understanding Reasoning in Thinking Language Models via Steering Vectors
- 2026What Matters for Latent Reasoning with Flow Matching
- 2026ThinkRouter: Efficient Reasoning via Routing Thinking between Latent and Discrete Spaces