Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Test-time compute can be scaled both sequentially and in parallel. Sequential scaling involves lengthening the generation process, while parallel scaling involves verifying and selecting among multiple candidate outputs. Combining these two strategies has led to the most powerful AI systems, such as Grok 4 Heavy and GPT-5 Pro. In certain contexts (e.g., solving Sudoku puzzles), verifying responses can be substantially easier than generating them. This property, referred to as asymmetric verification, highlights the strong potential of test-time scaling (TTS). In this work, we study both sequential and parallel TTS of deep search agents, motivated by the intuition that verification in this setting is often much easier than generation. In experiments, we first show that sequential scaling methods, such as budget forcing, can be effective initially but soon degrade performance. Leveraging asymmetric verification, however, we are able to achieve substantial improvements by allocating only a modest amount of compute to the verifier. We conduct experiments with flagship open-source models and extend them to their ``Heavy'' variants through TTS. These deep research agents achieve gains of up to 27 absolute points on benchmarks such as BrowseComp. Remarkably, as an open-source alternative, GLM-4.5 Heavy reaches accuracy of bf 54.0% on BrowseComp and bf 66.0% on GAIA, placing it comparable to the best proprietary choices such as OpenAI Deep Research. Tongyi-DeepResearch Heavy further achieves bf 69.0% accuracy on BrowseComp, greatly surpassing the best proprietary results.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 18 of its 28 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
18 of 28 references.
Closest ancestors · 3
Same direction, newest first
- 2025s1: Simple test-time scaling31 Jan
- 2024B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners23 Dec
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
Other references · 15
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024OpenAI o1 System Cardcited by 1,220
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 218
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 144
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 139
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025ParallelMuse: Agentic Parallel Thinking for Deep Information Seekingcited by 14
- 2025InteractComp: Evaluating Search Agents With Ambiguous Queriescited by 12
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agentscited by 9
- 2026Symphony: A Cognitively-Inspired Multi-Agent System for Long-Video Understandingcited by 8
- 2026Deep Search with Hierarchical Meta-Cognitive Monitoring Inspired by Cognitive Neurosciencecited by 5
- 2026Argus: Evidence Assembly for Scalable Deep Research Agentscited by 4
- 2026AREX: Towards a Recursively Self-Improving Agent for Deep Researchcited by 4
- 2026On the Overscaling Curse of Parallel Thinking: System Efficacy Contradicts Sample Efficiencycited by 1
- 2026Diagnosing and Mitigating Context Rot in Long-horizon Searchcited by 1
- 2026When and Why LLM Causal Priors Help: Closed-Loop Prior Selection for Amortized Causal Inferencecited by 0
- 2026TRACE: Trajectory Selection for Parallel Scaling of Search Agentscited by 0
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Taskscited by 0
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Tasks1 Oct 2026
- 2026TRACE: Trajectory Selection for Parallel Scaling of Search Agents30 Sep 2026
- 2026When and Why LLM Causal Priors Help: Closed-Loop Prior Selection for Amortized Causal Inference7 Sep 2026
- 2026AREX: Towards a Recursively Self-Improving Agent for Deep Research23 Jul 2026
- 2026Diagnosing and Mitigating Context Rot in Long-horizon Search29 Jun 2026
- 2026Argus: Evidence Assembly for Scalable Deep Research Agents15 May 2026
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agents29 Mar 2026
- 2026Symphony: A Cognitively-Inspired Multi-Agent System for Long-Video Understanding18 Mar 2026
- 2026Deep Search with Hierarchical Meta-Cognitive Monitoring Inspired by Cognitive Neuroscience30 Jan 2026
- 2026On the Overscaling Curse of Parallel Thinking: System Efficacy Contradicts Sample Efficiency29 Jan 2026
- 2025ParallelMuse: Agentic Parallel Thinking for Deep Information Seeking28 Oct 2025
- 2025InteractComp: Evaluating Search Agents With Ambiguous Queries28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Scaling Test-Time Compute Without Verification or RL is Suboptimal
- 2025Sample, Scrutinize and Scale: Effective Inference-Time Search by Scaling Verification
- 2026Test-Time Scaling in the Wild: Why Exploitation, Not Exploration, Is the Bottleneck
- 2025textttSPECS: Faster Test-Time Scaling through Speculative Drafts
- 2025Are We Scaling the Right Thing? A System Perspective on Test-Time Scaling
- 2025Trust but Verify! A Survey on Verification Design for Test-time Scaling
- 2025First Finish Search: Efficient Test-Time Scaling in Large Language Models
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Models