LAPO: Internalizing Reasoning Efficiency via Length-Adaptive Policy Optimization
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large reasoning models have achieved remarkable performance through extended chain-of-thought sequences, yet this computational freedom leads to excessive token generation even for simple problems. We present Length-Adaptive Policy Optimization (LAPO), a novel framework that transforms reasoning length control from an external constraint into an intrinsic model capability. Unlike existing approaches that impose rigid limits or rely on post-hoc interventions, LAPO enables models to internalize an understanding of appropriate reasoning depth through a two-stage reinforcement learning process. In the first stage, models learn natural reasoning patterns by discovering the statistical distribution of successful solution lengths. The second stage leverages these patterns as meta-cognitive guidance, embedding them directly within the model's reasoning context to ensure inference-time flexibility. Experiments on mathematical reasoning benchmarks demonstrate that LAPO reduces token usage by up to 40.9% while improving accuracy by 2.3%. Our analysis reveals that models trained with LAPO develop emergent abilities to allocate computational resources based on problem complexity, achieving efficient reasoning without sacrificing quality.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 34 of its 37 references that are in the map. First posted on arXiv 21 Jul 2025.
Builds on
34 of 37 references.
Closest ancestors · 21
Same direction, newest first
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025Thinkless: LLM Learns When to Think19 May
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
- 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL16 May
- 2025Scalable Chain of Thoughts via Elastic Reasoning8 May
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning8 May
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
9 more
- 2025s1: Simple test-time scaling31 Jan
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
- 2024Imitate, Explore, and Self-Improve: A Reproduction Report on Slow-thinking Reasoning Systems12 Dec
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
Other references · 13
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
- 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
- 2024Learning to Route LLMs with Confidence Tokenscited by 67
- 2025Think When You Need: Self-Adaptive Chain-of-Thought Learningcited by 38
Built on by
Citing papers per year: 2025: 5; 2026: 6.
11 papers.
- 2025BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokenscited by 29
- 2025LSPO: Length-aware Dynamic Sampling for Policy Optimization in LLM Reasoningcited by 9
- 2026StaRPO: Stability-Augmented Reinforcement Policy Optimizationcited by 5
- 2025From "Aha Moments" to Controllable Thinking: Toward Meta-Cognitive Reasoning in Large Reasoning Models via Decoupled Reasoning and Controlcited by 4
- 2025Overthinking Reduction with Decoupled Rewards and Curriculum Data Schedulingcited by 4
- 2025Rectifying LLM Thought from Lens of Optimizationcited by 4
- 2026Resource Consumption Threats in Large Language Modelscited by 2
- 2026Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneckcited by 1
- 2026Skill Reuse as Compression in Agentic RLcited by 1
- 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selectioncited by 0
- 2026Overthink-Triggered Slowdown Attacks on LVLM-Based Robotic Systemscited by 0
- 2026Overthink-Triggered Slowdown Attacks on LVLM-Based Robotic Systems1 Jul 2026
- 2026Skill Reuse as Compression in Agentic RL29 May 2026
- 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection27 Apr 2026
- 2026StaRPO: Stability-Augmented Reinforcement Policy Optimization10 Apr 2026
- 2026Resource Consumption Threats in Large Language Models17 Mar 2026
- 2026Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneck9 Mar 2026
- 2025Rectifying LLM Thought from Lens of Optimization1 Dec 2025
- 2025LSPO: Length-aware Dynamic Sampling for Policy Optimization in LLM Reasoning1 Oct 2025
- 2025Overthinking Reduction with Decoupled Rewards and Curriculum Data Scheduling30 Sep 2025
- 2025BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens24 Aug 2025
- 2025From "Aha Moments" to Controllable Thinking: Toward Meta-Cognitive Reasoning in Large Reasoning Models via Decoupled Reasoning and Control6 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Leash: Adaptive Length Penalty and Reward Shaping for Efficient Large Reasoning Model
- 2026Stepwise Penalization for Length-Efficient Chain-of-Thought Reasoning
- 2026Balancing the Reasoning Load: Difficulty-Differentiated Policy Optimization with Length Redistribution for Efficient and Robust Reinforcement Learning
- 2025HiPO: Hybrid Policy Optimization for Dynamic Reasoning in LLMs
- 2025How Far Are We from Optimal Reasoning Efficiency?
- 2025SmartThinker: Learning to Compress and Preserve Reasoning by Step-Level Length Control
- 2025AALC: Large Language Model Efficient Reasoning via Adaptive Accuracy-Length Control
- 2026To Think or Not to Think: Allocating Reasoning Where It Helps