CRISP: Critical Step Perception for Training Efficient Deep Search Agents
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Large language models (LLMs) are increasingly extended into deep search agents that solve complex questions through multi-step interaction with external search and browsing tools. However, existing agents often incur substantial computational and interaction costs, generating lengthy trajectories that contain redundant queries, inefficient exploration, and irrelevant observations. Existing efficiency-oriented methods usually encourage agents to use tools less frequently, but treating all tool interactions uniformly may also suppress steps that gather necessary evidence. In this paper, we propose CRISP, a framework for training efficient deep search agents through critical step perception. Unlike prior efficiency methods that uniformly penalize tool use, CRISP distinguishes interactions that gather necessary evidence from redundant ones and shapes the training reward to preserve the former while pruning the latter, improving efficiency without sacrificing the evidence needed for correct answers. Specifically, CRISP first constructs critical-step labels with Backward Evidence Induction: starting from the final answer, a strong model traverses a completed search trajectory backward and judges whether each tool-interaction step provides or preserves evidence for the final answer. We then distill these step-wise judgments into a smaller critical-step recognizer, enabling full-trajectory analysis in a single pass. During policy optimization, an efficiency-aware reward is applied only to successful rollouts. Experiments on BrowseComp and HLE-Verified show that CRISP maintains competitive final-answer accuracy while reducing average interaction turns by 15.1% and 33.2%, respectively, demonstrating substantial improvements in interaction efficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 30 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
24 of 30 references.
Closest ancestors · 7
Same direction, newest first
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents13 Jun
- 2025DeepWideSearch: Benchmarking Depth and Width in Agentic Information Seeking23 Oct
- 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Execution29 Sep
- 2025WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learning16 Sep
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challenges3 Aug
- 2025Deep Research Agents: A Systematic Examination And Roadmap22 Jun
- 2025Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agent12 May
Other references · 17
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 203
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 132
- 2025SMART: Self-Aware Agent for Tool Overuse Mitigationcited by 52
- 2025SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agentscited by 29
- 2025Beyond Turn Limits: Training Deep Search Agents with Dynamic Context Windowcited by 19
- 2026ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agentscited by 13
5 more
- 2026Verified Critical Step Optimization for LLM Agentscited by 13
- 2026Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Modelscited by 13
- 2026MatchTIR: Fine-Grained Supervision for Tool-Integrated Reasoning via Bipartite Matchingcited by 9
- 2026ET-Agent: Incentivizing Effective Tool-Integrated Reasoning Agent via Behavior Calibrationcited by 4
- 2026Efficient Agentic Reinforcement Learning with On-Policy Intrinsic Knowledge Boundary Enhancementcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SRR-Judge: Step-Level Rating and Refinement for Enhancing Search-Integrated Reasoning in Search Agents
- 2026Question's Gambit: The First Move Matters in Agentic Deep Search
- 2026PrimeSeeker: Capability-Oriented Supervision for Deep Search Agents
- 2026Search, Do not Guess: Teaching Small Language Models to Be Effective Search Agents
- 2026LexiHorizon: Stabilizing Reinforcement Learning for Long-Horizon Deep Search
- 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agents
- 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization
- 2026When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search