mlsanityData to 7 Oct 2026

Agentic AI Enhances Physician Trust in Clinical Decision Making

arXiv 2606.30658 ↗First posted 16 Jun 2026cs.CY cs.AIcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Medical AI has shifted from reasoning to agentic AI, a new paradigm that autonomously invokes external tools during reasoning, rendering intermediate reasoning steps and tool outputs transparent to users. Although proven to outperform previous models, physician trust in agentic AI remains largely unexplored. To address this, three physicians evaluated 315 multimodal clinical cases quantifying both process-oriented cognitive trust and outcome-oriented behavioral reliance. Comparing agentic AI against non-agentic baselines, physicians exhibited significantly higher cognitive and behavioral trust for the agentic model (P < 0.001). Specifically, on treatment planning tasks, physicians trusted the agentic reasoning most, preferring it in 89.57% of cases. Furthermore, process-oriented cognitive trust is significantly associated with outcome-oriented behavioral reliance (P < 0.001). However, measurable over-reliance on incorrect agentic outputs still exists, highlighting the inherent limitations of decision-logic transparency alone and underscoring the continuous need for rigorous clinician oversight.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 5 of its 18 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

5 of 18 references.

References · 5

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  5. 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026"Do I Trust the AI?" Towards Trustworthy AI-Assisted Diagnosis: Understanding User Perception in LLM-Supported Reasoning
  2. 2026Agentic AI, Medical Morality, and the Transformation of the Patient-Physician Relationship ↗
  3. 2026Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation
  4. 2026The Doctor Will (Still) See You Now: On the Structural Limits of Agentic AI in Healthcare
  5. 2026Grounding Clinical AI Competency in Human Cognition Through the Clinical World Model and Skill-Mix Framework
  6. 2026The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
  7. 2026MedAgent-R1: Faithfulness-Aware Reinforcement Learning for Evidence-Grounded Medical Reasoning
  8. 2026Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agents