ExOSITO: Explainable Off-Policy Learning with Side Information for Intensive Care Unit Blood Test Orders
Not on the map. Why?
Abstract (arXiv)
Ordering a minimal subset of lab tests for patients in the intensive care unit (ICU) can be challenging. Care teams must balance between ensuring the availability of the right information and reducing the clinical burden and costs associated with each lab test order. Most in-patient settings experience frequent over-ordering of lab tests, but are now aiming to reduce this burden on both hospital resources and the environment. This paper develops a novel method that combines off-policy learning with privileged information to identify the optimal set of ICU lab tests to order. Our approach, EXplainable Off-policy learning with Side Information for ICU blood Test Orders (ExOSITO) creates an interpretable assistive tool for clinicians to order lab tests by considering both the observed and predicted future status of each patient. We pose this problem as a causal bandit trained using offline data and a reward function derived from clinically-approved rules; we introduce a novel learning framework that integrates clinical knowledge with observational data to bridge the gap between the optimal and logging policies. The learned policy function provides interpretable clinical information and reduces costs without omitting any vital lab orders, outperforming both a physician's policy and prior approaches to this practical problem.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 81 references that are in the map. First posted on arXiv 24 Apr 2025.
Builds on
34 of 81 references.
References · 34
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
- 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,241
- 2019Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reductioncited by 840
- 2019Behavior Regularized Offline Reinforcement Learningcited by 662
- 2019Neural Spline Flowscited by 596
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 284
- 2019On Gradient Descent Ascent for Nonconvex-Concave Minimax Problemscited by 270
- 2019Batch Policy Learning under Constraintscited by 244
- 2019Learning Likelihoods with Conditional Normalizing Flowscited by 172
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139
22 more
- 2020PLAS: Latent Action Space for Offline Reinforcement Learningcited by 133
- 2020EMaQ: Expected-Max Q-Learning Operator for Simple Yet Effective Offline and Online RLcited by 115
- 2016Optimal and Adaptive Off-policy Evaluation in Contextual Banditscited by 111
- 2022Supported Policy Optimization for Offline Reinforcement Learningcited by 74
- 2020Off-policy Bandits with Deficient Supportcited by 61
- 2018Conditional Density Estimation with Bayesian Normalising Flowscited by 54
- 2023Leveraging Factored Action Spaces for Efficient Offline Reinforcement Learning in Healthcarecited by 42
- 2020Invertible Generative Modeling using Linear Rational Splinescited by 40
- 2021Local policy search with Bayesian optimizationcited by 38
- 2020Offline Policy Selection under Uncertaintycited by 31
- 2022Offline Reinforcement Learning for Safer Blood Glucose Control in People with Type 1 Diabetescited by 23
- 2022Normalizing Flows for Interventional Density Estimationcited by 21
- 2019Bayesian Optimization for Policy Search via Online-Offline Experimentationcited by 20
- 2023Supported Trust Region Optimization for Offline Reinforcement Learningcited by 20
- 2023Deep Offline Reinforcement Learning for Real-world Treatment Optimization Applicationscited by 17
- 2022Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learningcited by 16
- 2023Reliable Off-Policy Learning for Dosage Combinationscited by 15
- 2017Scalable Joint Models for Reliable Uncertainty-Aware Event Predictioncited by 13
- 2018An Optimal Policy for Patient Laboratory Tests in Intensive Care Unitscited by 7
- 2019Dynamic Measurement Scheduling for Event Forecasting using Deep RLcited by 7
- 2024Measurement Scheduling for ICU Patients with Offline Reinforcement Learningcited by 3
- 2021Prediction of Blood Lactate Values in Critically Ill Patients: A Retrospective Multi-center Cohort Studycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.