LifeSearch: Benchmarking Deep Research Agents for Real-World Life and Productivity
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Deep research (DR) agents address open-ended information needs through multi-step reasoning, long-horizon web search, and evidence synthesis. However, existing benchmarks primarily focus on academic research or synthetic tasks, leaving DR agents' capabilities in real-world life and professional productivity settings insufficiently evaluated. To bridge this gap, we introduce LifeSearch, a challenging benchmark comprising 203 Chinese and English tasks derived from real-user query seeds across 7 concrete life and productivity domains. With more than 4,500 hours of human annotation, we construct over 4,000 expert-written, fine-grained rubrics, covering both report-content criteria for coverage and accuracy and concrete criteria specifying values, units, dates, and URLs. We conduct extensive experiments on 12 advanced DR agents under a unified evaluation harness, systematically analyzing their performance patterns and failure modes. We find that even the best-performing frontier agent, GPT-5.6 Sol, achieves a score of only 63.4%, leaving substantial room for improvement on realistic life and professional DR tasks. We select the grading configuration by comparing candidate LLM judges against human rubric labels, and a human ranking study shows strong alignment between aggregate benchmark scores and human judgments (Spearman's ρ = 0.89, Kendall's τ = 0.81). LifeSearch provides a rigorous evaluation framework and foundation for advancing DR agents toward real-world life and productivity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 26 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
19 of 26 references.
Closest ancestors · 10
Same direction, newest first
- 2026DeepResearchEval: An Automated Framework for Deep Research Task Construction and Agentic Evaluation14 Jan
- 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents10 Nov
- 2025LiveResearchBench: A Live Benchmark for User-Centric Deep Research in the Wild16 Oct
- 2025Deep Research: A Survey of Autonomous Research Agents18 Aug
- 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Tasks14 Aug
- 2025WideSearch: Benchmarking Agentic Broad Info-Seeking11 Aug
- 2025Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge26 Jun
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun
- 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?22 Jul
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
Other references · 9
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025MedBrowseComp: Benchmarking Medical Deep Research and Computer Usecited by 30
- 2025Code Researcher: Deep Research Agent for Large Systems Code and Commit Historycited by 20
- 2025FinDeepResearch: Evaluating Deep Research Agents in Rigorous Financial Analysiscited by 14
- 2026DRACO: a Cross-Domain Benchmark for Deep Research Accuracy, Completeness, and Objectivitycited by 14
- 2026Can LLM-as-a-Judge Reliably Verify Rubrics in Agentic Scenarios?cited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Reports
- 2026DeepSearchQA: Bridging the Comprehensiveness Gap for Deep Research Agents
- 2025Deep Research Bench: Evaluating AI Web Research Agents
- 2025Dr. Bench: A Multidimensional Evaluation for Deep Research Agents, from Answers to Reports
- 2026MiroEval: Benchmarking Multimodal Deep Research Agents in Process and Outcome
- 2025Deep Research Agents: A Systematic Examination And Roadmap
- 2025Deep Research Comparator: A Platform For Fine-grained Human Annotations of Deep Research Agents
- 2026IDRBench: Benchmarking the Interactive Capabilities of Deep Research Agents