mlsanityData to 14 Oct 2026

LAPO: Internalizing Reasoning Efficiency via Length-Adaptive Policy Optimization

arXiv 2507.15758 ↗First posted 21 Jul 2025cs.AI cs.CLcited by 11

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large reasoning models have achieved remarkable performance through extended chain-of-thought sequences, yet this computational freedom leads to excessive token generation even for simple problems. We present Length-Adaptive Policy Optimization (LAPO), a novel framework that transforms reasoning length control from an external constraint into an intrinsic model capability. Unlike existing approaches that impose rigid limits or rely on post-hoc interventions, LAPO enables models to internalize an understanding of appropriate reasoning depth through a two-stage reinforcement learning process. In the first stage, models learn natural reasoning patterns by discovering the statistical distribution of successful solution lengths. The second stage leverages these patterns as meta-cognitive guidance, embedding them directly within the model's reasoning context to ensure inference-time flexibility. Experiments on mathematical reasoning benchmarks demonstrate that LAPO reduces token usage by up to 40.9% while improving accuracy by 2.3%. Our analysis reveals that models trained with LAPO develop emergent abilities to allocate computational resources based on problem complexity, achieving efficient reasoning without sacrificing quality.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 34 of its 37 references that are in the map. First posted on arXiv 21 Jul 2025.

Builds on

34 of 37 references.

Closest ancestors · 21

Same direction, newest first

  1. 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
  2. 2025Thinkless: LLM Learns When to Think19 May
  3. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
  4. 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL16 May
  5. 2025Scalable Chain of Thoughts via Elastic Reasoning8 May
  6. 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning8 May
  7. 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
  8. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  9. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  10. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
  11. 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
  12. 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
9 more
  1. 2025s1: Simple test-time scaling31 Jan
  2. 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
  3. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
  4. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  5. 2024Token-Budget-Aware LLM Reasoning24 Dec
  6. 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
  7. 2024Imitate, Explore, and Self-Improve: A Reproduction Report on Slow-thinking Reasoning Systems12 Dec
  8. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May

Other references · 13

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  6. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  7. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
  8. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  9. 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
  10. 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
  11. 2024Learning to Route LLMs with Confidence Tokenscited by 67
  12. 2025Think When You Need: Self-Adaptive Chain-of-Thought Learningcited by 38
1 more
  1. 2025HAPO: Training Language Models to Reason Concisely via History-Aware Policy Optimizationcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 6.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Leash: Adaptive Length Penalty and Reward Shaping for Efficient Large Reasoning Model
  2. 2026Stepwise Penalization for Length-Efficient Chain-of-Thought Reasoning
  3. 2026Balancing the Reasoning Load: Difficulty-Differentiated Policy Optimization with Length Redistribution for Efficient and Robust Reinforcement Learning
  4. 2025HiPO: Hybrid Policy Optimization for Dynamic Reasoning in LLMs
  5. 2025How Far Are We from Optimal Reasoning Efficiency?
  6. 2025SmartThinker: Learning to Compress and Preserve Reasoning by Step-Level Length Control
  7. 2025AALC: Large Language Model Efficient Reasoning via Adaptive Accuracy-Length Control
  8. 2026To Think or Not to Think: Allocating Reasoning Where It Helps