DualSpec: Accelerating Deep Research Agents via Dual-Process Action Speculation
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Large language model-based deep research agents have been increasingly popular for addressing long-horizon information-seeking tasks, but they often incur high end-to-end latency due to extensive reasoning and frequent tool use. Speculation frameworks aim to reduce latency by overlapping action execution with reasoning; however, existing approaches typically rely on uniform speculation strategies and strict action matching, which limits inference speedups and robustness. In this work, we revisit the speculate-verify paradigm for deep research agents through the lens of action heterogeneity. We show that textitSearch and textitVisit actions exhibit fundamentally different reasoning and model capacity requirements: entropy-based analysis reveals that Search decisions have higher uncertainty and benefit significantly from explicit reasoning, whereas Visit decisions have lower entropy and depend primarily on model capacity. Motivated by this dual-process characteristic, we propose DualSpec, a heterogeneous speculation framework equipped with a lightweight, confidence-based semantic verifier. Experiments across multiple models and benchmarks demonstrate that DualSpec achieves up to 3.28× end-to-end speedup while maintaining accuracy comparable to fully reasoning agents.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 29 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
26 of 29 references.
Closest ancestors · 4
Same direction, newest first
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scaling14 Nov
- 2025Deep Research Agents: A Systematic Examination And Roadmap22 Jun
- 2025WebDancer: Towards Autonomous Information Seeking Agency28 May
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
Other references · 22
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
- 2023An LLM Compiler for Parallel Function Callingcited by 170
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
- 2023Why think step by step? Reasoning emerges from the locality of experiencecited by 103
- 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 65
10 more
- 2025SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoningcited by 60
- 2025rStar2-Agent: Agentic Reasoning Technical Reportcited by 54
- 2023EcoAssistant: Using LLM Assistant More Affordably and Accuratelycited by 47
- 2024System-1.x: Learning to Balance Fast and Slow Planning with Language Modelscited by 35
- 2025Speculative Actions: A Lossless Framework for Faster Agentic Systemscited by 20
- 2025Accelerating Large Language Model Reasoning via Speculative Searchcited by 16
- 2024Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interfacecited by 15
- 2025Optimizing Sequential Multi-Step Tasks with Parallel LLM Agentscited by 14
- 2025Dynamic Speculative Agent Planningcited by 10
- 2025Reducing Latency of LLM Search Agent via Speculation-based Algorithm-System Co-Designcited by 6
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026DRACULA: Hunting for the Actions Users Want Deep Research Agents to Executecited by 1
- 2026Speculate While You Reason: Teaching Agents to Predict Their Next Tool Call via Joint Agent-Speculator RLcited by 1
- 2026AOSpec: Action and Observation Co-Speculation for Low-Latency Agent Servingcited by 1
- 2026Second Thought: Reasoning in Parallel as LLM Agents Act and Observecited by 0
- 2026DynBranch: Speculative Subgraph Reuse for Dynamic Agentic LLM Servingcited by 0
- 2026TomasuLLM: Out-of-Order Speculative Execution for LLM Agentscited by 0
- 2026DynBranch: Speculative Subgraph Reuse for Dynamic Agentic LLM Serving25 Sep 2026
- 2026TomasuLLM: Out-of-Order Speculative Execution for LLM Agents22 Sep 2026
- 2026Second Thought: Reasoning in Parallel as LLM Agents Act and Observe13 Aug 2026
- 2026AOSpec: Action and Observation Co-Speculation for Low-Latency Agent Serving1 Aug 2026
- 2026Speculate While You Reason: Teaching Agents to Predict Their Next Tool Call via Joint Agent-Speculator RL28 Jul 2026
- 2026DRACULA: Hunting for the Actions Users Want Deep Research Agents to Execute26 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization
- 2026Argus: Evidence Assembly for Scalable Deep Research Agents
- 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scaling
- 2025Deep Research: A Survey of Autonomous Research Agents
- 2026When Deep Research Agents Stagnate: Enhancing Reasoning with Retrieval-Aware Agent Control
- 2026Speculate with Memory: Lossless Acceleration for LLM Agents
- 2026DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoning
- 2026Explore Before Committing: Hypothesis-Guided Search for Deep Research Agents