mlsanityData to 14 Oct 2026

Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification

arXiv 2601.15808 ↗First posted 22 Jan 2026cs.AIcited by 22

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 2 more
Abstract (arXiv)

Recent advances in Deep Research Agents (DRAs) are transforming automated knowledge discovery and problem-solving. While the majority of existing efforts focus on enhancing policy capabilities via post-training, we propose an alternative paradigm: self-evolving the agent's ability by iteratively verifying the policy model's outputs, guided by meticulously crafted rubrics. This approach gives rise to the inference-time scaling of verification, wherein an agent self-improves by evaluating its generated answers to produce iterative feedback and refinements. We derive the rubrics based on an automatically constructed DRA Failure Taxonomy, which systematically classifies agent failures into five major categories and thirteen sub-categories. We present DeepVerifier, a rubrics-based outcome reward verifier that leverages the asymmetry of verification and outperforms vanilla agent-as-judge and LLM judge baselines by 12%-48% in meta-evaluation F1 score. To enable practical self-evolution, DeepVerifier integrates as a plug-and-play module during test-time inference. The verifier produces detailed rubric-based feedback, which is fed back to the agent for iterative bootstrapping, refining responses without additional training. This test-time scaling delivers 8%-11% accuracy gains on challenging subsets of GAIA and XBench-DeepSearch when powered by capable closed-source LLMs. Finally, to support open-source advancement, we release DeepVerifier-4K, a curated supervised fine-tuning dataset of 4,646 high-quality agent steps focused on DRA verification. These examples emphasize reflection and self-critique, enabling open models to develop robust verification capabilities.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 38 of its 58 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

38 of 58 references.

References · 38

  1. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  2. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  3. 2025Humanity's Last Examcited by 491
  4. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  5. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
  6. 2025TTRL: Test-Time Reinforcement Learningcited by 275
  7. 2024TextGrad: Automatic "Differentiation" via Textcited by 273
  8. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
  9. 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
  10. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
  11. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  12. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 137
26 more
  1. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 131
  2. 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 121
  3. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
  4. 2025Reinforcement Learning with Rubric Anchorscited by 113
  5. 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 108
  6. 2025Tongyi DeepResearch Technical Reportcited by 66
  7. 2025Scaling Test-time Compute for LLM Agentscited by 63
  8. 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 61
  9. 2025Self-Challenging Language Model Agentscited by 59
  10. 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
  11. 2025AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agentscited by 52
  12. 2025Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Trainingcited by 42
  13. 2025Guided Self-Evolving LLMs with Minimal Human Supervisioncited by 35
  14. 2025OAgents: An Empirical Study of Building Effective Agentscited by 29
  15. 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 17
  16. 2024WebSuite: Systematically Evaluating Why Web Agents Failcited by 16
  17. 2026PROGRESSLM: Towards Progress Reasoning in Vision-Language Modelscited by 15
  18. 2024TapeAgents: a Holistic Framework for Agent Development and Optimizationcited by 13
  19. 2025Step-DeepResearch Technical Reportcited by 12
  20. 2025How Far Are We from Genuinely Useful Deep Research Agents?cited by 11
  21. 2024Cognitive Kernel: An Open-source Agent System towards Generalist Autopilotscited by 10
  22. 2025Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agentscited by 10
  23. 2025Understanding DeepResearch via Reportscited by 7
  24. 2025The Path of Self-Evolving Large Language Models: Achieving Data-Efficient Learning via Intrinsic Feedbackcited by 6
  25. 2025QuadSentinel: Sequent Safety for Machine-Checkable Control in Multi-agent Systemscited by 4
  26. 2025Deep Self-Evolving Reasoningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 22.

22 papers.

Sort:

By area:

  1. 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
  2. 2026From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flawscited by 29
  3. 2026Marco DeepResearch: Unlocking Efficient Deep Research Agents via Verification-Centric Designcited by 16
  4. 2026Verified Critical Step Optimization for LLM Agentscited by 14
  5. 2026When Is Enough Not Enough? Illusory Completion in Search Agentscited by 5
  6. 2026AutoChecklist: Composable Pipelines for Checklist Generation and Scoring with LLM-as-a-Judgecited by 5
  7. 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscapecited by 4
  8. 2026Training LLM Agents for Spontaneous, Reward-Free Self-Evolution via World Knowledge Explorationcited by 3
  9. 2026SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoningcited by 1
  10. 2026Agentic Context Learning with Self-Discovered Specificationcited by 1
  11. 2026SkillTV-Bench: Benchmarking How Well Judges Perform on Skill-Augmented Agentic Executioncited by 1
  12. 2026Grounded Checklist Partial Credit for Agent Skill Trajectoriescited by 1
10 more
  1. 2026Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answeringcited by 0
  2. 2026Hybrid Open-Ended Tri-Evolution Makes Better Deep Researchercited by 0
  3. 2026Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agentscited by 0
  4. 2026Self-Designed Evaluators and Warm Memory for Long-Horizon Agentscited by 0
  5. 2026Traverse: Learning When to Remember, Reset, and Redirect for Long-Horizon Web Searchcited by 0
  6. 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Taskscited by 0
  7. 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimizationcited by 0
  8. 2026PANINI-DR: Controlled Deep Research through Generative Semantic Workspacescited by 0
  9. 2026Verifier-Harness Co-Evolution for Training-Free Self-Improvement on Open-Ended Taskscited by 0
  10. 2026Beyond the Verdict: Agentic Code Judging with Verifiable Feedbackcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Deep Research as Rubric for Reinforcement Learning
  2. 2026AREX: Towards a Recursively Self-Improving Agent for Deep Research
  3. 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning
  4. 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality
  5. 2026RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewards
  6. 2026Agentic Rubrics as Contextual Verifiers for SWE Agents
  7. 2026Verify Less, Evolve More: Training Idea-Level Critics for Verification-Efficient ML Evolving Agents
  8. 2026VeriTrace: Evolving Mental Models for Deep Research Agents