mlsanityData to 14 Oct 2026

Is Deep Research Reliable? Misleading Knowledge Induces False Conclusions

arXiv 2607.20891 ↗First posted 23 Jul 2026cs.AIcited by 4

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Deep Research agents conduct long-horizon investigations by iteratively planning, retrieving evidence, and generating reports. However, it remains unclear whether they can resist apparently credible but factually false information introduced into these workflows. To study this failure mode, we introduce MisKnow-Agent, a controlled evaluation framework that constructs task-specific documents supporting manually audited false conclusions with controlled authority cues and source styles. Applied to the tasks from DeepResearch Bench, it generates 5,933 misleading documents after filtering. We evaluate DeerFlow and WebThinker with three backbone LLMs, together with Gemini Deep Research, using a report-level false-conclusion adoption rate (FCAR) that counts only reports endorsing the false conclusion. Across the configurations, introducing one misleading document increases the mean FCAR from 0% in the no-injection control to 54.7%. FCAR varies substantially with lifecycle stage and framework design, and also with source authority and presentation style, whereas search-result rank and additional documents beyond the first have limited influence. Although cross-model verification consistently classifies retained instances as misleading, Deep Research agents can still adopt the corresponding false conclusions during long-horizon research. Pre- and post-research defenses reduce FCAR but do not eliminate adoption, motivating continuous verification when evidence enters intermediate research states and final synthesis. To facilitate reproducibility, our code and dataset are publicly available at https://github.com/whfeLingYu/MisKnow-Agent and https://huggingface.co/datasets/whfeLingYu/MisleadingKnowledge, respectively.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 46 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

15 of 46 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality6 Mar
  2. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun
  3. 2025DeepResearchGym: A Free, Transparent, and Reproducible Evaluation Sandbox for Deep Research25 May
  4. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
  5. 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun

Other references · 10

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  3. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  4. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  5. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  6. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  7. 2024Knowledge Conflicts for LLMs: A Surveycited by 283
  8. 2023Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noisecited by 54
  9. 2026Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scalecited by 29
  10. 2025SafeSearch: Automated Red-Teaming of LLM-Based Search Agentscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DRNOISE: Benchmarking Deep Research Agents in Misleading Evidence Environments
  2. 2026Towards Trustworthy Report Generation: A Deep Research Agent with Progressive Confidence Estimation and Calibration
  3. 2025How Far Are We from Genuinely Useful Deep Research Agents?
  4. 2026From Intent to Evidence: A Categorical Approach for Structural Evaluation of Deep Research Agents
  5. 2026From Fluent to Verifiable: Claim-Level Auditability for Deep Research Agents
  6. 2026Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
  7. 2025DEER: A Benchmark for Evaluating Deep Research Agents on Expert Report Generation
  8. 2026Can AI Agents Synthesize Scientific Conclusions?