mlsanityData to 14 Oct 2026

Who is the Agent to Blame? Localizing Faithfulness and Citation Mistakes in Agentic Deep Research

arXiv 2608.24306 ↗First posted 25 Aug 2026cs.CLcited by 1

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Deep research (DR) systems produce long-form cited reports by orchestrating multiple agents that search and synthesize information from the web. Citations are the primary mechanism for evaluating the faithfulness of these reports, yet current DR systems exhibit poor citation recall. Moreover, improving citation recall is challenging because DR systems are complex multi-agent architectures where information passes through agents like a telephone game, and both content and citations can get corrupted along the way. We propose an evaluation method that pinpoints which agent introduced each error by locally testing agent invocations for faithfulness and verifiability relative to their own inputs. Furthermore, we propose a four-type taxonomy to categorize the discovered errors: hallucination, uncited input reliance, uncited output, or insufficient citations. Applying our method to three top-ranked open-source DR systems, we obtain actionable diagnostics. Almost every agent makes a lot of mistakes with the exception being those that summarize a single document. We find that the dominant error type varies systematically across agents, where the orchestrator mistakes are mostly citation-related. We find that 84.7% of final-report errors in AI-Q originate at the orchestrator, roughly 31% of them hallucinations and the rest citation mistakes. Guided by these insights, we demonstrate that two simple interventions raise citation recall by 5% without degrading output quality.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 24 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

15 of 24 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agents7 May
  2. 2026DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Reports13 Jan
  3. 2025DEER: A Benchmark for Evaluating Deep Research Agents on Expert Report Generation19 Dec
  4. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun

Other references · 11

  1. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  2. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  3. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
  4. 2025Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 104
  5. 2024LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QAcited by 81
  6. 2025WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Researchcited by 46
  7. 2025DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesiscited by 34
  8. 2022Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarizationcited by 32
  9. 2019Citation Needed: A Taxonomy and Algorithmic Assessment of Wikipedia's Verifiabilitycited by 16
  10. 2025LAQuer: Localized Attribution Queries in Content-grounded Generationcited by 13
  11. 2025Precise Information Control in Long-Form Text Generationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating and Guarding Citation Faithfulness in Agentic Scientific Synthesis
  2. 2025How Far Are We from Genuinely Useful Deep Research Agents?
  3. 2026DRNOISE: Benchmarking Deep Research Agents in Misleading Evidence Environments
  4. 2026Beyond the Text: Verifying That Agent-Written Papers Are Backed by Their Artifacts
  5. 2026DREAM: Deep Research Evaluation with Agentic Metrics
  6. 2026From Fluent to Verifiable: Claim-Level Auditability for Deep Research Agents
  7. 2026Beyond Single-shot Writing: Deep Research Agents are Unreliable at Multi-turn Report Revision
  8. 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Tasks