From Uncertainty to Clinical Risk: Severity-Aware Conformal Planning for Interactive Medical Diagnosis
Not on the map. Why?
Abstract (arXiv)
Interactive medical diagnosis dynamically acquires patient information through multiple rounds of questioning, supporting accurate, efficient, and safe clinical decisions under incomplete evidence. Existing methods commonly guide information acquisition with predictive uncertainty or label ambiguity, but overlook the asymmetric clinical risk of missing severe diseases and lack unified long-horizon planning over whether to continue asking questions or commit to a diagnosis. To address these limitations, we propose Severity-Aware Conformal Clinical Planning, which formulates interactive diagnosis as a risk-sensitive sequential decision problem. The framework maintains complementary diagnostic, safety, and masked-evidence beliefs; calibrates turn-specific diagnostic prediction sets and severity-weighted differential-diagnosis risk on held-out diagnostic trajectories; and introduces the calibrated clinical risk into Monte Carlo Tree Search to jointly evaluate long-horizon Ask and Commit trajectories. Experiments on DDXPlus and MediQ show that our method achieves more accurate diagnoses with fewer questions across multiple large language models, while improving differential-diagnosis quality and reducing high-risk errors in severe cases. These findings validate the value of using clinical risk, rather than predictive uncertainty alone, as a planning signal and demonstrate the effectiveness of the proposed framework for information acquisition and risk-aware diagnostic decision making. They also motivate future work on clinical-risk-oriented interactive diagnosis and information-acquisition methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
22 of 39 references.
References · 22
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2020Classification with Valid and Adaptive Coveragecited by 396
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 154
- 2024Benchmarking LLMs via Uncertainty Quantificationcited by 126
- 2023Class-Conditional Conformal Prediction with Many Classescited by 109
- 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 101
- 2024Large language model validity via enhanced conformal prediction methodscited by 92
- 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 88
10 more
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 77
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Trainingcited by 57
- 2023Learning to Maximize Mutual Information for Dynamic Feature Selectioncited by 56
- 2024Conformal Alignment: Knowing When to Trust Foundation Models with Guaranteescited by 54
- 2024Uncertainty in Language Models: Assessment through Rank-Calibrationcited by 41
- 2025BED-LLM: Intelligent Information Gathering with LLMs and Bayesian Experimental Designcited by 24
- 2025MEDDxAgent: A Unified Modular Agent Framework for Explainable Automatic Differential Diagnosiscited by 23
- 2024Active, anytime-valid risk controlling prediction setscited by 14
- 2024Early Time Classification with Accumulated Accuracy Gap Controlcited by 11
- 2025Timely Clinical Diagnosis through Active Test Selectioncited by 4
Built on by
Not cited yet.