LightSearcher: Efficient DeepSearch via Experiential Memory
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
DeepSearch paradigms have become a core enabler for deep reasoning models, allowing them to invoke external search tools to access up-to-date, domain-specific knowledge beyond parametric boundaries, thereby enhancing the depth and factual reliability of reasoning. Building upon this foundation, recent advances in reinforcement learning (RL) have further empowered models to autonomously and strategically control search tool usage, optimizing when and how to query external knowledge sources. Yet, these RL-driven DeepSearch systems often reveal a see-saw trade-off between accuracy and efficiency-frequent tool invocations can improve factual correctness but lead to unnecessary computational overhead and diminished efficiency. To address this challenge, we propose LightSearcher, an efficient RL framework that incorporates textual experiential memory by learning contrastive reasoning trajectories to generate interpretable summaries of successful reasoning patterns. In addition, it employs an adaptive reward shaping mechanism that penalizes redundant tool calls only in correct-answer scenarios. This design effectively balances the inherent accuracy-efficiency trade-off in DeepSearch paradigms. Experiments on four multi-hop QA benchmarks show that LightSearcher maintains accuracy comparable to SOTA baseline ReSearch, while reducing search tool invocations by 39.6%, inference time by 48.6%, and token consumption by 21.2%, demonstrating its superior efficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 38 references that are in the map. First posted on arXiv 7 Dec 2025.
Builds on
20 of 38 references.
Closest ancestors · 3
Same direction, newest first
- 2025Synergizing RAG and Reasoning: A Systematic Review22 Apr
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning12 Mar
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec
Other references · 17
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 226
- 2023Large Language Models in Finance: A Surveycited by 223
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
- 2025Acting Less is Reasoning More! Teaching Model to Act Efficientlycited by 80
5 more
- 2025SMART: Self-Aware Agent for Tool Overuse Mitigationcited by 52
- 2024Self-DC: When to Reason and When to Act? Self Divide-and-Conquer for Compositional Unknown Questionscited by 30
- 2024Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrievalcited by 26
- 2024SMARTCAL: An Approach to Self-Aware Tool-Use Evaluation and Calibrationcited by 13
- 2025ADO: Automatic Data Optimization for Inputs in LLM Promptscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DeepSearch: Overcome the Bottleneck of Reinforcement Learning with Verifiable Rewards via Monte Carlo Tree Search
- 2025R-Search: Empowering LLM Reasoning with Search via Multi-Reward Reinforcement Learning
- 2026Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents with Citation-Aware Rubric Rewards
- 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization
- 2026LexiHorizon: Stabilizing Reinforcement Learning for Long-Horizon Deep Search
- 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RL
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning
- 2026Scaling Retrieval-Augmented Reasoning with Parallel Search and Explicit Merging