mlsanityData to 14 Oct 2026

Towards Trustworthy Report Generation: A Deep Research Agent with Progressive Confidence Estimation and Calibration

arXiv 2604.05952 ↗First posted 7 Apr 2026cs.AI cs.CLcited by 1

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

As agent-based systems continue to evolve, deep research agents are capable of automatically generating research-style reports across diverse domains. While these agents promise to streamline information synthesis and knowledge exploration, existing evaluation frameworks-typically based on subjective dimensions-fail to capture a critical aspect of report quality: trustworthiness. In open-ended research scenarios where ground-truth answers are unavailable, current evaluation methods cannot effectively measure the epistemic confidence of generated content, making calibration difficult and leaving users susceptible to misleading or hallucinated information. To address this limitation, we propose a novel deep research agent that incorporates progressive confidence estimation and calibration within the report generation pipeline. Our system leverages a deliberative search model, featuring deep retrieval and multi-hop reasoning to ground outputs in verifiable evidence while assigning confidence scores to individual claims. Combined with a carefully designed workflow, this approach produces trustworthy reports with enhanced transparency. Experimental results and case studies demonstrate that our method substantially improves interpretability and significantly increases user trust.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 27 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

21 of 27 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challenges3 Aug
  2. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun
  3. 2025Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges12 Jun

Other references · 18

  1. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  2. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  3. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  4. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  5. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  6. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  7. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Taskscited by 206
  8. 2023Quantifying Uncertainty in Answers from any Language Model and Enhancing their Trustworthinesscited by 122
  9. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
  10. 2025Confidence Improves Self-Consistency in LLMscited by 113
  11. 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Toolscited by 106
  12. 2024On Verbalized Confidence Scores for LLMscited by 83
6 more
  1. 2024Calibrating Large Language Models with Sample Consistencycited by 73
  2. 2023DSformer: A Double Sampling Transformer for Multivariate Time Series Long-term Predictioncited by 49
  3. 2025Your Pre-trained LLM is Secretly an Unsupervised Confidence Calibratorcited by 20
  4. 2024QA-Calibration of Language Model Confidence Scorescited by 13
  5. 2023On the Calibration of Multilingual Question Answering LLMscited by 6
  6. 2024On using Machine Learning Algorithms for Motorcycle Collision Detectioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Tasks
  2. 2026Is Deep Research Reliable? Misleading Knowledge Induces False Conclusions
  3. 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality
  4. 2025How Far Are We from Genuinely Useful Deep Research Agents?
  5. 2025DEER: A Benchmark for Evaluating Deep Research Agents on Expert Report Generation
  6. 2026DualStake: Dual-Path Confidence Calibration in Deep Research Agents
  7. 2025DeepTRACE: Auditing Deep Research AI Systems for Tracking Reliability Across Citations and Evidence
  8. 2026DRNOISE: Benchmarking Deep Research Agents in Misleading Evidence Environments