Why Your Deep Research Agent Fails? On Hallucination Evaluation in Full Research Trajectory
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Diagnosing failure patterns in Deep Research Agents (DRAs) remains a critical challenge. Existing benchmarks predominantly rely on end-to-end evaluation, obscuring intermediate hallucinations that accumulate throughout the research trajectory. To bridge this gap, we propose a shift from outcome-based to process-aware evaluation by auditing hallucinations in the full plan-search-summarize trajectory. We introduce the PING Taxonomy, which categorizes DRA hallucinations into four complementary types: Propagation, Intent, Noise-induced, and Grounding. We further instantiate this taxonomy into a fine-grained evaluation framework that decomposes trajectories into atomic actions, claims, and sub-queries for rigorous verification, and we validate its reliability on standard fact-checking benchmarks and human-reviewed trajectories. Leveraging this framework to isolate 100 hallucination-prone tasks, including adversarial scenarios, we curate DeepHalluBench. Experiments on six representative DRAs show that, on our hallucination-prone stress-test set, all evaluated systems still exhibit non-negligible reliability gaps. Furthermore, our diagnostic analysis traces these failures to systemic deficits, especially hallucination propagation and cognitive biases, providing actionable insights for future architectural optimization. Code and data are available at https://github.com/yuhao-zhan/DeepHalluBench.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 77 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
39 of 77 references.
Closest ancestors · 2
Same direction, newest first
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directions23 Sep
- 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detector17 Jun
Other references · 37
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 236
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 170
- 2024Long-form factuality in large language modelscited by 146
25 more
- 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 122
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
- 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
- 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
- 2025Deep Research: A Survey of Autonomous Research Agentscited by 63
- 2024RaFe: Ranking Feedback Improves Query Rewriting for RAGcited by 47
- 2025LiveResearchBench: A Live Benchmark for User-Centric Deep Research in the Wildcited by 35
- 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Taskscited by 34
- 2026DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Reportscited by 33
- 2025DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesiscited by 31
- 2025ResearcherBench: Evaluating Deep AI Research Systems on the Frontiers of Scientific Inquirycited by 30
- 2025DeepResearch Arena: The First Exam of LLMs' Research Abilities via Seminar-Grounded Taskscited by 24
- 2024Atomic Fact Decomposition Helps Attributed Question Answeringcited by 21
- 2026MMDeepResearch-Bench: A Benchmark for Multimodal Deep Research Agentscited by 21
- 2025Beyond the Final Answer: Evaluating the Reasoning Trajectories of Tool-Augmented Agentscited by 20
- 2025Enterprise Deep Research: Steerable Multi-Agent Deep Research for Enterprise Analyticscited by 20
- 2025DRBench: A Realistic Benchmark for Enterprise Deep Researchcited by 19
- 2025Towards Personalized Deep Research: Benchmarks and Evaluationscited by 14
- 2025Enhancing Mathematical Reasoning in Large Language Models with Self-Consistency-Based Hallucination Detectioncited by 13
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
- 2026DeepResearchEval: An Automated Framework for Deep Research Task Construction and Agentic Evaluationcited by 13
- 2025DEER: A Benchmark for Evaluating Deep Research Agents on Expert Report Generationcited by 12
- 2025Behavioral Analysis of Information Salience in Large Language Modelscited by 11
- 2025ARC: Argument Representation and Coverage Analysis for Zero-Shot Long Document Summarization with Instruction Following LLMscited by 3
- 2025Beyond Facts: Evaluating Intent Hallucination in Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?cited by 10
- 2026How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Taskscited by 4
- 2026SearchAuditor: Auditing and Attributing Failures in Long-Horizon Search Agentscited by 1
- 2026Tracing the Cascade: A Topology-Aware Evaluation Framework for Scientific Agent Hallucinationscited by 0
- 2026PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMscited by 0
- 2026PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs7 Oct 2026
- 2026How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks14 Aug 2026
- 2026SearchAuditor: Auditing and Attributing Failures in Long-Horizon Search Agents5 Aug 2026
- 2026Tracing the Cascade: A Topology-Aware Evaluation Framework for Scientific Agent Hallucinations1 Aug 2026
- 2026Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?18 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026AgentHallu: Benchmarking Automated Hallucination Attribution of LLM-based Agents
- 2026HalluClear: Diagnosing, Evaluating and Mitigating Hallucinations in GUI Agents
- 2025MIRAGE-Bench: LLM Agent is Hallucinating and Where to Find Them
- 2026Beyond Final Answers: Auditing Trajectory-Level Hallucinations in Multi-Agent Industrial Workflows
- 2026Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models
- 2026Hallucinations Live in Variance
- 2026LexAgentHallu: A Hierarchical Benchmark for Profiling Hallucinations in Legal Agents
- 2025Auditing Meta-Cognitive Hallucinations in Reasoning Large Language Models