LightThinker++: From Reasoning Compression to Memory Management
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models (LLMs) excel at complex reasoning, yet their efficiency is limited by the surging cognitive overhead of long thought traces. In this paper, we propose LightThinker, a method that enables LLMs to dynamically compress intermediate thoughts into compact semantic representations. However, static compression often struggles with complex reasoning where the irreversible loss of intermediate details can lead to logical bottlenecks. To address this, we evolve the framework into LightThinker++, introducing Explicit Adaptive Memory Management. This paradigm shifts to behavioral-level management by incorporating explicit memory primitives, supported by a specialized trajectory synthesis pipeline to train purposeful memory scheduling. Extensive experiments demonstrate the framework's versatility across three dimensions. (1) LightThinker reduces peak token usage by 70% and inference time by 26% with minimal accuracy loss. (2) In standard reasoning, LightThinker++ slashes peak token usage by 69.9% while yielding a +2.42% accuracy gain under the same context budget for maximum performance. (3) Most notably, in long-horizon agentic tasks, it maintains a stable footprint beyond 80 rounds (a 60%-70% reduction), achieving an average performance gain of 14.8% across different complex scenarios. Overall, our work provides a scalable direction for sustaining deep LLM reasoning over extended horizons with minimal overhead.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 39 of its 77 references that are in the map. First posted on arXiv 4 Apr 2026.
Builds on
39 of 77 references.
Closest ancestors · 8
Same direction, newest first
- 2026Dynamic Long Context Reasoning over Compressed Memory via End-to-End Reinforcement Learning9 Feb
- 2026Free(): Learning to Forget in Malloc-Only Reasoning Models8 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
- 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Model17 Oct
- 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost29 Jul
Other references · 31
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023A Survey of Large Language Modelscited by 2,576
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 432
- 2025Training Language Models to Reason Efficientlycited by 247
19 more
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 235
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
- 2023Implicit Chain of Thought Reasoning via Knowledge Distillationcited by 176
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 148
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 145
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 141
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 121
- 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 117
- 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 103
- 2025When Thinking Fails: The Pitfalls of Reasoning for Instruction-Following in LLMscited by 53
- 2024SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separatorcited by 41
- 2024Break the Chain: Large Language Models Can be Shortcut Reasonerscited by 32
- 2025System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcutscited by 27
- 2024SCOPE: Optimizing Key-Value Cache Compression in Long-context Generationcited by 20
- 2026The Pensieve Paradigm: Stateful Language Models Mastering Their Own Contextcited by 9
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Self-Compacting Language Model Agentscited by 11
- 2026Training Continuous Chain of Thought Models: A Tale of Two Regimescited by 2
- 2026MemoSight: Unifying Context Compression and Multi Token Prediction for Reasoning Accelerationcited by 1
- 2026HybridThinker: Efficient Chain-of-Thought Reasoning via Compressed Memory and Transient Thought Stepscited by 0
- 2026Training Continuous Chain of Thought Models: A Tale of Two Regimes18 Jul 2026
- 2026Self-Compacting Language Model Agents22 Jun 2026
- 2026HybridThinker: Efficient Chain-of-Thought Reasoning via Compressed Memory and Transient Thought Steps2 Jun 2026
- 2026MemoSight: Unifying Context Compression and Multi Token Prediction for Reasoning Acceleration16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025LightThinker: Thinking Step-by-Step Compression
- 2024LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation
- 2026Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoning
- 2026Shorthand for Thought: Compressing LLM Reasoning via Entropy-Guided Supertokens
- 2026KARA: Efficient Reasoning LLM Serving via Sliding-Window KV Cache Compression
- 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
- 2025ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Compute
- 2026VTC-R1: Vision-Text Compression for Efficient Long-Context Reasoning