mlsanityData to 14 Oct 2026

Optimizing Length Compression in Large Reasoning Models

arXiv 2506.14755 ↗First posted 17 Jun 2025cs.AI cs.CLcited by 38

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Reasoning Models (LRMs) have achieved remarkable success, yet they often suffer from producing unnecessary and verbose reasoning chains. We identify a core aspect of this issue as "invalid thinking" -- models tend to repeatedly double-check their work after having derived the correct answer. To address this specific inefficiency, we move beyond the general principles of Efficacy and Efficiency to propose two new, fine-grained principles: Brevity, which advocates for eliminating redundancy, and Sufficiency, which ensures critical reasoning steps are preserved. Guided by these principles, we introduce LC-R1, a post-training method based on Group Relative Policy Optimization (GRPO). LC-R1 employs a novel combination of a Length Reward for overall conciseness and a Compress Reward that is specifically designed to remove the invalid portion of the thinking process. Extensive experiments on multiple reasoning benchmarks demonstrate that LC-R1 achieves a significant reduction in sequence length (~50%) with only a marginal (~2%) drop in accuracy, achieving a favorable trade-off point on the Pareto frontier that prioritizes high compression. Our analysis further validates the robustness of LC-R1 and provides valuable insights for developing more powerful yet computationally efficient LRMs. Our code is released at https://github.com/zxiangx/LC-R1.

Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 46 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

27 of 46 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025Learn to Reason Efficiently with Adaptive Length-based Reward Shaping21 May
  2. 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning30 Apr
  3. 2025Dynamic Early Exit in Reasoning Models22 Apr
  4. 2025Reasoning Models Can Be Effective Without Thinking14 Apr
  5. 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
  6. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  7. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  8. 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
  9. 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
  10. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
  11. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  12. 2024Token-Budget-Aware LLM Reasoning24 Dec

Other references · 15

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2023Let's Verify Step by Stepcited by 3,789
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  9. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  10. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  11. 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 300
  12. 2025Training Language Models to Reason Efficientlycited by 247
3 more
  1. 2024Distilling System 2 into System 1cited by 159
  2. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
  3. 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Modelscited by 70

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 24.

38 papers.

Sort:

By area:

  1. 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoningcited by 75
  2. 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
  3. 2025DLER: Doing Length pEnalty Right - Incentivizing More Intelligence per Token via Reinforcement Learningcited by 35
  4. 2025Promoting Efficient Reasoning with Verifiable Stepwise Rewardcited by 28
  5. 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?cited by 19
  6. 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
  7. 2025Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoningcited by 13
  8. 2026Self-Compression of Chain-of-Thought via Multi-Agent Reinforcement Learningcited by 13
  9. 2025DiffAdapt: Difficulty-Adaptive Reasoning for Token-Efficient LLM Inferencecited by 11
  10. 2026Step Potential Advantage Estimation: Harnessing Intermediate Confidence and Correctness for Efficient Mathematical Reasoningcited by 9
  11. 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Modelscited by 8
  12. 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluationcited by 7
26 more
  1. 2026Tackling Length Inflation Without Trade-offs: Group Relative Reward Rescaling for Reinforcement Learningcited by 7
  2. 2025PEAR: Phase Entropy Aware Reward for Efficient Reasoningcited by 5
  3. 2025Overthinking Reduction with Decoupled Rewards and Curriculum Data Schedulingcited by 4
  4. 2025Towards Flash Thinking via Decoupled Advantage Policy Optimizationcited by 4
  5. 2026ConPress: Learning Efficient Reasoning from Multi-Question Contextual Pressurecited by 4
  6. 2026S3-CoT: Self-Sampled Succinct Reasoning Enables Efficient Chain-of-Thought LLMscited by 4
  7. 2025Entropy-Guided Reasoning Compressioncited by 3
  8. 2026Stepwise Penalization for Length-Efficient Chain-of-Thought Reasoningcited by 3
  9. 2026Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMscited by 3
  10. 2026CoTJudger: A Graph-Driven Framework for Automatic Evaluation of Chain-of-Thought Efficiency and Redundancy in LRMscited by 3
  11. 2025Think Right: Learning to Mitigate Under-Over Thinking via Adaptive, Attentive Compressioncited by 2
  12. 2025Adaptive Dual Reasoner: Large Reasoning Models Can Think Efficiently by Hybrid Reasoningcited by 2
  13. 2025Efficient Reasoning via Reward Modelcited by 2
  14. 2026Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Modelscited by 2
  15. 2026TRiMS: Real-Time Tracking of Minimal Sufficient Length for Efficient Reasoning via RLcited by 2
  16. 2026ExpThink: Experience-Guided Reinforcement Learning for Adaptive Chain-of-Thought Compressioncited by 2
  17. 2026QA-Merging: Query-Adaptive Reasoning via Layer Selective Model Mergingcited by 1
  18. 2026Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneckcited by 1
  19. 2026Implicit Compression Regularization: Concise Reasoning via Internal Shorter Distributions in RL Post-Trainingcited by 1
  20. 2026SLAT: Segment-Level Adaptive Trimming for Efficient CoT Reasoningcited by 1
  21. 2026Adaptive Latent Agentic Reasoningcited by 1
  22. 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimizationcited by 1
  23. 2026LLMs are not stochastic parrots: Evidence for meaning-mediated abstraction from conlang-like taskscited by 1
  24. 2026ENTRA: Entropy-Based Redundancy Avoidance in Large Language Model Reasoningcited by 0
  25. 2026APR: Penalizing Structural Redundancy in Large Reasoning Models via Anchor-based Process Rewardscited by 0
  26. 2026SKIP: a Self-knowledge-guided Step-wise Preference Learning Framework for Concise Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
  2. 2026Beyond Penalizing Mistakes: Stabilizing Efficiency Training in Large Reasoning Models via Adaptive Correct-Only Rewards
  3. 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
  4. 2026Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning
  5. 2026ConMax: Confidence-Maximizing Compression for Efficient Chain-of-Thought Reasoning
  6. 2026Fewer Tokens, Smaller Cache: Reward-Coordinated Efficient Reasoning
  7. 2025When Reasoning Meets Compression: Understanding the Effects of LLMs Compression on Large Reasoning Models
  8. 2026Reasoning Compression with Mixed-Policy Distillation