Safe to Stop? Risk-Constrained Stopping for Sequential Clinical Diagnosis Agents
Not on the map. Why?
Abstract (arXiv)
Clinical diagnosis agents must decide not only what test to request next, but also when to diagnose or defer. Existing agent benchmarks largely evaluate accuracy after fixed or unconstrained interaction, leaving autonomous stopping reliability implicit. We present Cros, a risk-constrained stopping layer combining state-wise error ranking, policy design on disjoint development splits, and LTT-style exact tests of selective diagnostic error and minimum autonomous coverage for complete sequential policies. Its finite-sample guarantee requires the candidate family, testing rule, and any randomization to be frozen before calibration labels are accessed. On a 1,834-episode MIMIC-derived abdominal-pain benchmark, the full ranker achieves exploratory state-error AUROC 0.853, compared with 0.715 for maximum class probability and 0.552 for the backbone's native stop score. On the previously viewed 367-episode evaluation split, analytically averaging over the frozen Cros weights yields 16.9% selective error at 78.8% coverage, cost 5.57, and 0.68 tests, versus 30.8% error at 100% coverage, cost 8.14, and 1.53 tests under native stopping. Forced continuation is non-monotone: error is 28.3% with HPI alone and 34.3% after full workup. However, the uniform-weight mixture ablation is cheaper on this viewed split despite missing the locked development margins, and Cros nominally satisfies the joint criterion in only 6 of 20 development resplits. Because evaluation labels were inspected during earlier development, these findings provide exploratory feasibility and audit evidence, not a confirmatory safety certificate.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 31 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
26 of 31 references.
References · 26
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
- 2022Conformal Risk Controlcited by 299
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
- 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 271
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 154
- 2025Sequential Diagnosis with Language Modelscited by 60
- 2022Efficiently Controlling Multiple Risks with Pareto Testingcited by 22
- 2023Deep Reinforcement Learning for Cost-Effective Medical Diagnosiscited by 21
- 2024Medchain: Bridging the Gap Between LLM Agents and Clinical Practice with Interactive Sequencecited by 17
14 more
- 2025Language Agents for Hypothesis-driven Clinical Decision Making with Reinforcement Learningcited by 15
- 2026Conformal Selective Prediction with General Risk Controlcited by 12
- 2024Early Time Classification with Accumulated Accuracy Gap Controlcited by 11
- 2025Selective Conformal Risk Controlcited by 11
- 2026Conformal Thinking: Risk Control for Reasoning on a Compute Budgetcited by 10
- 2026Adaptive Stopping for Multi-Turn LLM Reasoningcited by 7
- 2025Uncertainty-aware abstention in medical diagnosis based on medical textscited by 6
- 2026Geometry-Calibrated Conformal Abstention for Language Modelscited by 5
- 2025Timely Clinical Diagnosis through Active Test Selectioncited by 4
- 2026Look Again Before You Abstain:Budgeted Conformal Evidence Acquisition for Reliable Vision-Language Modelcited by 3
- 2026Uncertainty-Guided Latent Diagnostic Trajectory Learning for Sequential Clinical Diagnosiscited by 2
- 2026Optimal Stopping in Sequential Clinical Predictioncited by 1
- 2026Thinking Like a Clinician: A Cognitive AI Agent for Clinical Diagnosis via Panoramic Profiling and Adversarial Debatecited by 1
- 2026Ask Before You Diagnose: Safe-Psych, a Sequential Evaluation Benchmark for LLMs in Psychiatrycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.