Optimizing Length Compression in Large Reasoning Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Reasoning Models (LRMs) have achieved remarkable success, yet they often suffer from producing unnecessary and verbose reasoning chains. We identify a core aspect of this issue as "invalid thinking" -- models tend to repeatedly double-check their work after having derived the correct answer. To address this specific inefficiency, we move beyond the general principles of Efficacy and Efficiency to propose two new, fine-grained principles: Brevity, which advocates for eliminating redundancy, and Sufficiency, which ensures critical reasoning steps are preserved. Guided by these principles, we introduce LC-R1, a post-training method based on Group Relative Policy Optimization (GRPO). LC-R1 employs a novel combination of a Length Reward for overall conciseness and a Compress Reward that is specifically designed to remove the invalid portion of the thinking process. Extensive experiments on multiple reasoning benchmarks demonstrate that LC-R1 achieves a significant reduction in sequence length (~50%) with only a marginal (~2%) drop in accuracy, achieving a favorable trade-off point on the Pareto frontier that prioritizes high compression. Our analysis further validates the robustness of LC-R1 and provides valuable insights for developing more powerful yet computationally efficient LRMs. Our code is released at https://github.com/zxiangx/LC-R1.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 46 references that are in the map. First posted on arXiv 17 Jun 2025.
Builds on
27 of 46 references.
Closest ancestors · 12
Same direction, newest first
- 2025Learn to Reason Efficiently with Adaptive Length-based Reward Shaping21 May
- 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning30 Apr
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Reasoning Models Can Be Effective Without Thinking14 Apr
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Token-Budget-Aware LLM Reasoning24 Dec
Other references · 15
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Let's Verify Step by Stepcited by 3,789
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 300
- 2025Training Language Models to Reason Efficientlycited by 247
Built on by
Citing papers per year: 2025: 14; 2026: 24.
38 papers.
Sort:
By area:
- 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoningcited by 75
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
- 2025DLER: Doing Length pEnalty Right - Incentivizing More Intelligence per Token via Reinforcement Learningcited by 35
- 2025Promoting Efficient Reasoning with Verifiable Stepwise Rewardcited by 28
- 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?cited by 19
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2025Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoningcited by 13
- 2026Self-Compression of Chain-of-Thought via Multi-Agent Reinforcement Learningcited by 13
- 2025DiffAdapt: Difficulty-Adaptive Reasoning for Token-Efficient LLM Inferencecited by 11
- 2026Step Potential Advantage Estimation: Harnessing Intermediate Confidence and Correctness for Efficient Mathematical Reasoningcited by 9
- 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Modelscited by 8
- 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluationcited by 7
26 more
- 2026Tackling Length Inflation Without Trade-offs: Group Relative Reward Rescaling for Reinforcement Learningcited by 7
- 2025PEAR: Phase Entropy Aware Reward for Efficient Reasoningcited by 5
- 2025Overthinking Reduction with Decoupled Rewards and Curriculum Data Schedulingcited by 4
- 2025Towards Flash Thinking via Decoupled Advantage Policy Optimizationcited by 4
- 2026ConPress: Learning Efficient Reasoning from Multi-Question Contextual Pressurecited by 4
- 2026S3-CoT: Self-Sampled Succinct Reasoning Enables Efficient Chain-of-Thought LLMscited by 4
- 2025Entropy-Guided Reasoning Compressioncited by 3
- 2026Stepwise Penalization for Length-Efficient Chain-of-Thought Reasoningcited by 3
- 2026Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMscited by 3
- 2026CoTJudger: A Graph-Driven Framework for Automatic Evaluation of Chain-of-Thought Efficiency and Redundancy in LRMscited by 3
- 2025Think Right: Learning to Mitigate Under-Over Thinking via Adaptive, Attentive Compressioncited by 2
- 2025Adaptive Dual Reasoner: Large Reasoning Models Can Think Efficiently by Hybrid Reasoningcited by 2
- 2025Efficient Reasoning via Reward Modelcited by 2
- 2026Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Modelscited by 2
- 2026TRiMS: Real-Time Tracking of Minimal Sufficient Length for Efficient Reasoning via RLcited by 2
- 2026ExpThink: Experience-Guided Reinforcement Learning for Adaptive Chain-of-Thought Compressioncited by 2
- 2026QA-Merging: Query-Adaptive Reasoning via Layer Selective Model Mergingcited by 1
- 2026Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneckcited by 1
- 2026Implicit Compression Regularization: Concise Reasoning via Internal Shorter Distributions in RL Post-Trainingcited by 1
- 2026SLAT: Segment-Level Adaptive Trimming for Efficient CoT Reasoningcited by 1
- 2026Adaptive Latent Agentic Reasoningcited by 1
- 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimizationcited by 1
- 2026LLMs are not stochastic parrots: Evidence for meaning-mediated abstraction from conlang-like taskscited by 1
- 2026ENTRA: Entropy-Based Redundancy Avoidance in Large Language Model Reasoningcited by 0
- 2026APR: Penalizing Structural Redundancy in Large Reasoning Models via Anchor-based Process Rewardscited by 0
- 2026SKIP: a Self-knowledge-guided Step-wise Preference Learning Framework for Concise Reasoningcited by 0
- 2026LLMs are not stochastic parrots: Evidence for meaning-mediated abstraction from conlang-like tasks28 Sep 2026
- 2026SKIP: a Self-knowledge-guided Step-wise Preference Learning Framework for Concise Reasoning15 Sep 2026
- 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization22 Jul 2026
- 2026Adaptive Latent Agentic Reasoning1 Jun 2026
- 2026SLAT: Segment-Level Adaptive Trimming for Efficient CoT Reasoning29 May 2026
- 2026ExpThink: Experience-Guided Reinforcement Learning for Adaptive Chain-of-Thought Compression8 May 2026
- 2026Implicit Compression Regularization: Concise Reasoning via Internal Shorter Distributions in RL Post-Training8 May 2026
- 2026TRiMS: Real-Time Tracking of Minimal Sufficient Length for Efficient Reasoning via RL18 Mar 2026
- 2026Tackling Length Inflation Without Trade-offs: Group Relative Reward Rescaling for Reinforcement Learning11 Mar 2026
- 2026Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneck9 Mar 2026
- 2026CoTJudger: A Graph-Driven Framework for Automatic Evaluation of Chain-of-Thought Efficiency and Redundancy in LRMs7 Mar 2026
- 2026Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMs28 Feb 2026
26 more
- 2026Stepwise Penalization for Length-Efficient Chain-of-Thought Reasoning27 Feb 2026
- 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation10 Feb 2026
- 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?9 Feb 2026
- 2026S3-CoT: Self-Sampled Succinct Reasoning Enables Efficient Chain-of-Thought LLMs2 Feb 2026
- 2026ConPress: Learning Efficient Reasoning from Multi-Question Contextual Pressure1 Feb 2026
- 2026APR: Penalizing Structural Redundancy in Large Reasoning Models via Anchor-based Process Rewards31 Jan 2026
- 2026Self-Compression of Chain-of-Thought via Multi-Agent Reinforcement Learning29 Jan 2026
- 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Models16 Jan 2026
- 2026ENTRA: Entropy-Based Redundancy Avoidance in Large Language Model Reasoning12 Jan 2026
- 2026Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Models7 Jan 2026
- 2026Step Potential Advantage Estimation: Harnessing Intermediate Confidence and Correctness for Efficient Mathematical Reasoning7 Jan 2026
- 2026QA-Merging: Query-Adaptive Reasoning via Layer Selective Model Merging7 Jan 2026
- 2025Entropy-Guided Reasoning Compression18 Nov 2025
- 2025Efficient Reasoning via Reward Model12 Nov 2025
- 2025DiffAdapt: Difficulty-Adaptive Reasoning for Token-Efficient LLM Inference22 Oct 2025
- 2025Towards Flash Thinking via Decoupled Advantage Policy Optimization17 Oct 2025
- 2025DLER: Doing Length pEnalty Right - Incentivizing More Intelligence per Token via Reinforcement Learning16 Oct 2025
- 2025Adaptive Dual Reasoner: Large Reasoning Models Can Think Efficiently by Hybrid Reasoning11 Oct 2025
- 2025PEAR: Phase Entropy Aware Reward for Efficient Reasoning9 Oct 2025
- 2025Think Right: Learning to Mitigate Under-Over Thinking via Adaptive, Attentive Compression2 Oct 2025
- 2025Overthinking Reduction with Decoupled Rewards and Curriculum Data Scheduling30 Sep 2025
- 2025Promoting Efficient Reasoning with Verifiable Stepwise Reward14 Aug 2025
- 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoning13 Aug 2025
- 2025Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoning4 Aug 2025
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models4 Aug 2025
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey13 Jul 2025
- 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoningcited by 75
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
- 2025DLER: Doing Length pEnalty Right - Incentivizing More Intelligence per Token via Reinforcement Learningcited by 35
- 2025Promoting Efficient Reasoning with Verifiable Stepwise Rewardcited by 28
- 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?cited by 19
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2025Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoningcited by 13
- 2026Self-Compression of Chain-of-Thought via Multi-Agent Reinforcement Learningcited by 13
- 2025DiffAdapt: Difficulty-Adaptive Reasoning for Token-Efficient LLM Inferencecited by 11
- 2026Step Potential Advantage Estimation: Harnessing Intermediate Confidence and Correctness for Efficient Mathematical Reasoningcited by 9
- 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Modelscited by 8
- 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluationcited by 7
12 most cited of 36 All 36 (JSON)
- 2026SKIP: a Self-knowledge-guided Step-wise Preference Learning Framework for Concise Reasoning15 Sep 2026
- 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization22 Jul 2026
- 2026Adaptive Latent Agentic Reasoning1 Jun 2026
- 2026SLAT: Segment-Level Adaptive Trimming for Efficient CoT Reasoning29 May 2026
- 2026ExpThink: Experience-Guided Reinforcement Learning for Adaptive Chain-of-Thought Compression8 May 2026
- 2026Implicit Compression Regularization: Concise Reasoning via Internal Shorter Distributions in RL Post-Training8 May 2026
- 2026TRiMS: Real-Time Tracking of Minimal Sufficient Length for Efficient Reasoning via RL18 Mar 2026
- 2026Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneck9 Mar 2026
- 2026CoTJudger: A Graph-Driven Framework for Automatic Evaluation of Chain-of-Thought Efficiency and Redundancy in LRMs7 Mar 2026
- 2026Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMs28 Feb 2026
- 2026Stepwise Penalization for Length-Efficient Chain-of-Thought Reasoning27 Feb 2026
- 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation10 Feb 2026
12 newest of 36 All 36 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
- 2026Beyond Penalizing Mistakes: Stabilizing Efficiency Training in Large Reasoning Models via Adaptive Correct-Only Rewards
- 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
- 2026Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning
- 2026ConMax: Confidence-Maximizing Compression for Efficient Chain-of-Thought Reasoning
- 2026Fewer Tokens, Smaller Cache: Reward-Coordinated Efficient Reasoning
- 2025When Reasoning Meets Compression: Understanding the Effects of LLMs Compression on Large Reasoning Models
- 2026Reasoning Compression with Mixed-Policy Distillation