mlsanityData to 7 Oct 2026

Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning

arXiv 2604.09150 ↗First posted 10 Apr 2026cs.CLcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Reasoning Models (LRMs) achieve strong performance on complex tasks by leveraging long Chain-of-Thought (CoT), but often suffer from overthinking, leading to excessive reasoning steps and high inference latency. Existing CoT compression methods struggle to balance accuracy and efficiency, and lack fine-grained, step-level adaptation to redundancy and reasoning bias. Therefore, we propose State-Aware Reasoning Compression with Knowledge Guidance (STACK), a framework that performs step-wise CoT compression by explicitly modeling stage-specific redundancy sources and integrating with a retrieval-augmented guidance. STACK constructs online long-short contrastive samples and dynamically switches between knowledge-guided compression for uncertain or biased reasoning state and self-prompted compression for overly long but confident state, complemented by an answer-convergence-based early stopping mechanism to suppress redundant verification. We further propose a reward-difference-driven training strategy by combining Proximal Policy Optimization (PPO) and Direct Preference Optimization (DPO), enabling models to learn state-conditioned compression strategies. Experiments on three mathematical reasoning benchmarks show that STACK achieves a superior accuracy-efficiency balance, reducing average response length by 59.9% while improving accuracy by 4.8 points over existing methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 30 of its 47 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

30 of 47 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025TokenSqueeze: Performance-Preserving Compression for Reasoning LLMs17 Nov
  2. 2025Thinkless: LLM Learns When to Think19 May
  3. 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
  4. 2025Efficient Inference for Large Reasoning Models: A Survey29 Mar
  5. 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond27 Mar
  6. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  7. 2025InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language Models9 Mar
  8. 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
  9. 2025Self-Training Elicits Concise Reasoning in Large Language Models27 Feb
  10. 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
  11. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
  12. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec
1 more
  1. 2024Imitate, Explore, and Self-Improve: A Reproduction Report on Slow-thinking Reasoning Systems12 Dec

Other references · 17

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  5. 2024OpenAI o1 System Cardcited by 1,220
  6. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  7. 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 540
  8. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  9. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
  10. 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 277
  11. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
  12. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
5 more
  1. 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 38
  2. 2024Over-Reasoning and Redundant Calculation of Large Language Modelscited by 27
  3. 2024DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinationscited by 23
  4. 2025Auditing Meta-Cognitive Hallucinations in Reasoning Large Language Modelscited by 19
  5. 2025Early Stopping Chain-of-thoughts in Large Language Modelscited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
  2. 2025Optimizing Length Compression in Large Reasoning Models
  3. 2026ConMax: Confidence-Maximizing Compression for Efficient Chain-of-Thought Reasoning
  4. 2026Towards Efficient Large Language Reasoning Models via Extreme-Ratio Chain-of-Thought Compression
  5. 2025TrimR: Verifier-based Training-Free Thinking Compression for Efficient Test-Time Scaling
  6. 2025Pruning the Unsurprising: Efficient LLM Reasoning via First-Token Surprisal
  7. 2026Selective Latent Thinking: Adaptive Compression of LLM Reasoning Chains
  8. 2026Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoning