Deep Reinforcement Learning for Sepsis Treatment
Not on the map. Why?
Abstract (arXiv)
Sepsis is a leading cause of mortality in intensive care units and costs hospitals billions annually. Treating a septic patient is highly challenging, because individual patients respond very differently to medical interventions and there is no universally agreed-upon treatment for sepsis. In this work, we propose an approach to deduce treatment policies for septic patients by using continuous state-space models and deep reinforcement learning. Our model learns clinically interpretable treatment policies, similar in important aspects to the treatment policies of physicians. The learned policies could be used to aid intensive care clinicians in medical decision making and improve the likelihood of patient survival.
Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 7; 2022: 13; 2023: 16; 2024: 16; 2025: 11; 2026: 6.
71 papers.
Sort:
By area:
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
- 2021Model Selection for Offline Reinforcement Learning: Practical Considerations for Healthcare Settingscited by 68
- 2022The Health Gym: Synthetic Health-Related Datasets for the Development of Reinforcement Learning Algorithmscited by 19
- 2023Deep Offline Reinforcement Learning for Real-world Treatment Optimization Applicationscited by 17
- 2021Unifying Cardiovascular Modelling with Deep Reinforcement Learning for Uncertainty Aware Control of Sepsis Treatmentcited by 16
- 2022Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learningcited by 16
- 2023Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounderscited by 13
- 2023Finding Counterfactually Optimal Action Sequences in Continuous State Spacescited by 13
- 2023Hundreds Guide Millions: Adaptive Offline Reinforcement Learning with Expert Guidancecited by 13
- 2019Inverse Reinforcement Learning in Contextual MDPscited by 12
- 2023A Survey of Demonstration Learningcited by 12
- 2023Synthetic Health-related Longitudinal Data with Mixed-type Variables Generated using Diffusion Modelscited by 11
38 more
- 2025medDreamer: Model-Based Reinforcement Learning with Latent Imagination on Complex EHRs for Clinical Decision Supportcited by 9
- 2023On the Importance of Feature Decorrelation for Unsupervised Representation Learning in Reinforcement Learningcited by 8
- 2021Challenges for Reinforcement Learning in Healthcarecited by 7
- 2022Optimizing Pessimism in Dynamic Treatment Regimes: A Bayesian Learning Approachcited by 7
- 2023Quasi-optimal Reinforcement Learning with Continuous Actionscited by 7
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confoundingcited by 7
- 2023Off-policy Evaluation in Doubly Inhomogeneous Environmentscited by 7
- 2023Imitate the Good and Avoid the Bad: An Incremental Approach to Safe Reinforcement Learningcited by 7
- 2024SPRINQL: Sub-optimal Demonstrations driven Offline Imitation Learningcited by 7
- 2022Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventionscited by 6
- 2024ICU-Sepsis: A Benchmark MDP Built from Real Medical Datacited by 6
- 2022A Conservative Q-Learning approach for handling distribution shift in sepsis treatment strategiescited by 5
- 2022Deconfounding Actor-Critic Network with Policy Adaptation for Dynamic Treatment Regimescited by 5
- 2023HOPE: Human-Centric Off-Policy Evaluation for E-Learning and Healthcarecited by 5
- 2024Reinforcement Learning in Dynamic Treatment Regimes Needs Critical Reexaminationcited by 5
- 2022Learning Optimal Dynamic Treatment Regimes Using Causal Tree Methods in Medicinecited by 4
- 2022Learning Optimal Treatment Strategies for Sepsis Using Offline Reinforcement Learning in Continuous Spacecited by 4
- 2024Finite-Time Convergence and Sample Complexity of Actor-Critic Multi-Objective Reinforcement Learningcited by 4
- 2024Advancing Multi-Organ Disease Care: A Hierarchical Multi-Agent Reinforcement Learning Frameworkcited by 4
- 2024Offline Inverse Constrained Reinforcement Learning for Safe-Critical Decision Making in Healthcarecited by 4
- 2025Reinforcement Learning for Individual Optimal Policy from Heterogeneous Datacited by 4
- 2021Discovering an Aid Policy to Minimize Student Evasion Using Offline Reinforcement Learningcited by 3
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Surveycited by 3
- 2022Predicting the Need for Blood Transfusion in Intensive Care Units with Reinforcement Learningcited by 3
- 2022Practical Approaches for Fair Learning with Multitype and Multivariate Sensitive Attributescited by 3
- 2024TEE4EHR: Transformer Event Encoder for Better Representation Learning in Electronic Health Recordscited by 3
- 2024Counterfactual Reasoning Using Predicted Latent Personality Dimensions for Optimizing Persuasion Outcomecited by 3
- 2024Preference Elicitation for Offline Reinforcement Learningcited by 3
- 2024Medical Knowledge Integration into Reinforcement Learning Algorithms for Dynamic Treatment Regimescited by 3
- 2025Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Datacited by 3
- 2025Causal Discovery and Counterfactual Reasoning to Optimize Persuasive Dialogue Policiescited by 3
- 2021InferNet for Delayed Reinforcement Tasks: Addressing the Temporal Credit Assignment Problemcited by 2
- 2024Empowering Clinicians with Medical Decision Transformers: A Framework for Sepsis Treatmentcited by 2
- 2025Generative Framework for Personalized Persuasion: Inferring Causal, Counterfactual, and Latent Knowledgecited by 2
- 2025Off-Policy Evaluation Under Nonignorable Missing Datacited by 2
- 2025MIMIC-Sepsis: A Curated Benchmark for Modeling and Learning from Sepsis Trajectories in the ICUcited by 2
- 2026Agentifying Patient Dynamics within LLMs through Interacting with Clinical World Modelcited by 2
- 2026EHR-MPC: Inference-Time Control for Sepsis Treatment with Generative Patient Digital Twinscited by 2
50 most cited of 71 All 71 (JSON)
- 2026CNA: An AI-Oriented Comprehensive Normalized Assessment for Healthy Status and Application to Optimize RRT Strategies by Reinforcement Learning3 Sep 2026
- 2026EHR-MPC: Inference-Time Control for Sepsis Treatment with Generative Patient Digital Twins7 Jul 2026
- 2026Off-Policy Evaluation for Missingness-Aware Policies in MDPs with Rewards Missing Not at Random18 Jun 2026
- 2026VentAgent: When LLMs Learn to Breathe -- Multi-Objective Arbitration for ARDS Ventilation3 Jun 2026
- 2026Agentifying Patient Dynamics within LLMs through Interacting with Clinical World Model14 May 2026
- 2026From Pixels to Digital Agents: An Empirical Study on the Taxonomy and Technological Trends of Reinforcement Learning Environments25 Mar 2026
- 2025TECM*: A Data-Driven Assessment to Reinforcement Learning Methods and Application to Heparin Treatment Strategy for Surgical Sepsis2 Dec 2025
- 2025MIMIC-Sepsis: A Curated Benchmark for Modeling and Learning from Sepsis Trajectories in the ICU28 Oct 2025
- 2025DeepEN: A Deep Reinforcement Learning Framework for Personalized Enteral Nutrition in Critical Care9 Oct 2025
- 2025Control of dynamical systems with neural networks6 Oct 2025
- 2025Off-Policy Evaluation Under Nonignorable Missing Data9 Jul 2025
- 2025Treatment, evidence, imitation, and chat29 Jun 2025
38 more
- 2025medDreamer: Model-Based Reinforcement Learning with Latent Imagination on Complex EHRs for Clinical Decision Support26 May 2025
- 2025Reinforcement Learning for Individual Optimal Policy from Heterogeneous Data14 May 2025
- 2025Generative Framework for Personalized Persuasion: Inferring Causal, Counterfactual, and Latent Knowledge8 Apr 2025
- 2025Causal Discovery and Counterfactual Reasoning to Optimize Persuasive Dialogue Policies19 Mar 2025
- 2025Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data11 Feb 2025
- 2024Identifying Differential Patient Care Through Inverse Intent Inference11 Nov 2024
- 2024Off-Policy Selection for Initiating Human-Centric Experimental Design26 Oct 2024
- 2024Offline Inverse Constrained Reinforcement Learning for Safe-Critical Decision Making in Healthcare10 Oct 2024
- 2024Advancing Multi-Organ Disease Care: A Hierarchical Multi-Agent Reinforcement Learning Framework6 Sep 2024
- 2024Empowering Clinicians with Medical Decision Transformers: A Framework for Sepsis Treatment28 Jul 2024
- 2024MiranDa: Mimicking the Learning Processes of Human Doctors to Achieve Causal Inference for Medication Recommendation23 Jul 2024
- 2024Medical Knowledge Integration into Reinforcement Learning Algorithms for Dynamic Treatment Regimes29 Jun 2024
- 2024Preference Elicitation for Offline Reinforcement Learning26 Jun 2024
- 2024ICU-Sepsis: A Benchmark MDP Built from Real Medical Data9 Jun 2024
- 2024Reinforcement Learning in Dynamic Treatment Regimes Needs Critical Reexamination28 May 2024
- 2024Finite-Time Convergence and Sample Complexity of Actor-Critic Multi-Objective Reinforcement Learning5 May 2024
- 2024Counterfactual Reasoning Using Predicted Latent Personality Dimensions for Optimizing Persuasion Outcome21 Apr 2024
- 2024Reward Design for Justifiable Sequential Decision-Making24 Feb 2024
- 2024SPRINQL: Sub-optimal Demonstrations driven Offline Imitation Learning20 Feb 2024
- 2024Optimizing Warfarin Dosing Using Contextual Bandit: An Offline Policy Learning and Evaluation Method16 Feb 2024
- 2024TEE4EHR: Transformer Event Encoder for Better Representation Learning in Electronic Health Records9 Feb 2024
- 2023Imitate the Good and Avoid the Bad: An Incremental Approach to Safe Reinforcement Learning16 Dec 2023
- 2023Reinforcement learning in large, structured action spaces: A simulation study of decision support for spinal cord injury rehabilitation23 Oct 2023
- 2023Hundreds Guide Millions: Adaptive Offline Reinforcement Learning with Expert Guidance4 Sep 2023
- 2023Reinforcement Logic Rule Learning for Temporal Point Processes11 Aug 2023
- 2023Deep Attention Q-Network for Personalized Treatment Recommendation4 Jul 2023
- 2023Off-policy Evaluation in Doubly Inhomogeneous Environments14 Jun 2023
- 2023On the Importance of Feature Decorrelation for Unsupervised Representation Learning in Reinforcement Learning9 Jun 2023
- 2023Finding Counterfactually Optimal Action Sequences in Continuous State Spaces6 Jun 2023
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confounding1 Jun 2023
- 2023A optimization framework for herbal prescription planning based on deep reinforcement learning25 Apr 2023
- 2023Synthetic Health-related Longitudinal Data with Mixed-type Variables Generated using Diffusion Models22 Mar 2023
- 2023A Survey of Demonstration Learning20 Mar 2023
- 2023HOPE: Human-Centric Off-Policy Evaluation for E-Learning and Healthcare18 Feb 2023
- 2023Deep Offline Reinforcement Learning for Real-world Treatment Optimization Applications15 Feb 2023
- 2023Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounders1 Feb 2023
- 2023Quasi-optimal Reinforcement Learning with Continuous Actions21 Jan 2023
- 2022Practical Approaches for Fair Learning with Multitype and Multivariate Sensitive Attributes11 Nov 2022
50 newest of 71 All 71 (JSON)
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
- 2021Model Selection for Offline Reinforcement Learning: Practical Considerations for Healthcare Settingscited by 68
- 2023Deep Offline Reinforcement Learning for Real-world Treatment Optimization Applicationscited by 17
- 2022Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learningcited by 16
- 2023Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounderscited by 13
- 2023Hundreds Guide Millions: Adaptive Offline Reinforcement Learning with Expert Guidancecited by 13
- 2019Inverse Reinforcement Learning in Contextual MDPscited by 12
- 2023A Survey of Demonstration Learningcited by 12
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confoundingcited by 7
- 2024SPRINQL: Sub-optimal Demonstrations driven Offline Imitation Learningcited by 7
- 2024Reinforcement Learning in Dynamic Treatment Regimes Needs Critical Reexaminationcited by 5
- 2025Reinforcement Learning for Individual Optimal Policy from Heterogeneous Datacited by 4
12 most cited of 15 All 15 (JSON)
- 2026Off-Policy Evaluation for Missingness-Aware Policies in MDPs with Rewards Missing Not at Random18 Jun 2026
- 2025Reinforcement Learning for Individual Optimal Policy from Heterogeneous Data14 May 2025
- 2024Preference Elicitation for Offline Reinforcement Learning26 Jun 2024
- 2024Reinforcement Learning in Dynamic Treatment Regimes Needs Critical Reexamination28 May 2024
- 2024SPRINQL: Sub-optimal Demonstrations driven Offline Imitation Learning20 Feb 2024
- 2023Hundreds Guide Millions: Adaptive Offline Reinforcement Learning with Expert Guidance4 Sep 2023
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confounding1 Jun 2023
- 2023A Survey of Demonstration Learning20 Mar 2023
- 2023Deep Offline Reinforcement Learning for Real-world Treatment Optimization Applications15 Feb 2023
- 2023Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounders1 Feb 2023
- 2022Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning5 Oct 2022
- 2021Model Selection for Offline Reinforcement Learning: Practical Considerations for Healthcare Settings23 Jul 2021
12 newest of 15 All 15 (JSON)
- 2025medDreamer: Model-Based Reinforcement Learning with Latent Imagination on Complex EHRs for Clinical Decision Supportcited by 9
- 2024ICU-Sepsis: A Benchmark MDP Built from Real Medical Datacited by 6
- 2024Finite-Time Convergence and Sample Complexity of Actor-Critic Multi-Objective Reinforcement Learningcited by 4
- 2024Medical Knowledge Integration into Reinforcement Learning Algorithms for Dynamic Treatment Regimescited by 3
- 2025medDreamer: Model-Based Reinforcement Learning with Latent Imagination on Complex EHRs for Clinical Decision Support26 May 2025
- 2024Medical Knowledge Integration into Reinforcement Learning Algorithms for Dynamic Treatment Regimes29 Jun 2024
- 2024ICU-Sepsis: A Benchmark MDP Built from Real Medical Data9 Jun 2024
- 2024Finite-Time Convergence and Sample Complexity of Actor-Critic Multi-Objective Reinforcement Learning5 May 2024
- 2024Reward Design for Justifiable Sequential Decision-Makingcited by 0
- 2024Reward Design for Justifiable Sequential Decision-Making24 Feb 2024
- 2022The Health Gym: Synthetic Health-Related Datasets for the Development of Reinforcement Learning Algorithmscited by 19
- 2021Unifying Cardiovascular Modelling with Deep Reinforcement Learning for Uncertainty Aware Control of Sepsis Treatmentcited by 16
- 2023Finding Counterfactually Optimal Action Sequences in Continuous State Spacescited by 13
- 2023On the Importance of Feature Decorrelation for Unsupervised Representation Learning in Reinforcement Learningcited by 8
- 2021Challenges for Reinforcement Learning in Healthcarecited by 7
- 2022Optimizing Pessimism in Dynamic Treatment Regimes: A Bayesian Learning Approachcited by 7
- 2023Quasi-optimal Reinforcement Learning with Continuous Actionscited by 7
- 2023Off-policy Evaluation in Doubly Inhomogeneous Environmentscited by 7
- 2023Imitate the Good and Avoid the Bad: An Incremental Approach to Safe Reinforcement Learningcited by 7
- 2022Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventionscited by 6
- 2022A Conservative Q-Learning approach for handling distribution shift in sepsis treatment strategiescited by 5
- 2022Deconfounding Actor-Critic Network with Policy Adaptation for Dynamic Treatment Regimescited by 5
12 most cited of 48 All 48 (JSON)
- 2026CNA: An AI-Oriented Comprehensive Normalized Assessment for Healthy Status and Application to Optimize RRT Strategies by Reinforcement Learning3 Sep 2026
- 2026EHR-MPC: Inference-Time Control for Sepsis Treatment with Generative Patient Digital Twins7 Jul 2026
- 2026VentAgent: When LLMs Learn to Breathe -- Multi-Objective Arbitration for ARDS Ventilation3 Jun 2026
- 2025TECM*: A Data-Driven Assessment to Reinforcement Learning Methods and Application to Heparin Treatment Strategy for Surgical Sepsis2 Dec 2025
- 2025MIMIC-Sepsis: A Curated Benchmark for Modeling and Learning from Sepsis Trajectories in the ICU28 Oct 2025
- 2025DeepEN: A Deep Reinforcement Learning Framework for Personalized Enteral Nutrition in Critical Care9 Oct 2025
- 2025Control of dynamical systems with neural networks6 Oct 2025
- 2025Off-Policy Evaluation Under Nonignorable Missing Data9 Jul 2025
- 2025Treatment, evidence, imitation, and chat29 Jun 2025
- 2025Generative Framework for Personalized Persuasion: Inferring Causal, Counterfactual, and Latent Knowledge8 Apr 2025
- 2025Causal Discovery and Counterfactual Reasoning to Optimize Persuasive Dialogue Policies19 Mar 2025
- 2025Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data11 Feb 2025
12 newest of 48 All 48 (JSON)