A Novel Multi-Task Teacher-Student Architecture with Self-Supervised Pretraining for 48-Hour Vasoactive-Inotropic Trend Analysis in Sepsis Mortality Prediction
Not on the map. Why?
Abstract (arXiv)
Sepsis is a major cause of ICU mortality, where early recognition and effective interventions are essential for improving patient outcomes. However, the vasoactive-inotropic score (VIS) varies dynamically with a patient's hemodynamic status, complicated by irregular medication patterns, missing data, and confounders, making sepsis prediction challenging. To address this, we propose a novel Teacher-Student multitask framework with self-supervised VIS pretraining via a Masked Autoencoder (MAE). The teacher model performs mortality classification and severity-score regression, while the student distills robust time-series representations, enhancing adaptation to heterogeneous VIS data. Compared to LSTM-based methods, our approach achieves an AUROC of 0.82 on MIMIC-IV 3.0 (9,476 patients), outperforming the baseline (0.74). SHAP analysis revealed that SOFA score (0.147) had the greatest impact on ICU mortality, followed by LODS (0.033), single marital status (0.031), and Medicaid insurance (0.023), highlighting the role of sociodemographic factors. SAPSII (0.020) also contributed significantly. These findings suggest that both clinical and social factors should be considered in ICU decision-making. Our novel multitask and distillation strategies enable earlier identification of high-risk patients, improving prediction accuracy and disease management, offering new tools for ICU decision support.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 48 references that are in the map. First posted on arXiv 24 Feb 2025.
Builds on
17 of 48 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
- 2019Adversarially Robust Distillationcited by 125
- 2023Lightweight Transformers for Clinical Natural Language Processingcited by 15
- 2021Solving a class of non-convex min-max games using adaptive momentum methodscited by 10
- 2021A Decentralized Adaptive Momentum Method for Solving a Class of Min-Max Optimization Problemscited by 9
- 2023Explainable Knowledge Distillation for On-device Chest X-Ray Classificationcited by 8
5 more
- 2024EMIT- Event-Based Masked Auto Encoding for Irregular Time Seriescited by 5
- 2023An Explainable Deep Learning-Based Method For Schizophrenia Diagnosis Using Generative Data-Augmentationcited by 4
- 2024Data-Driven Machine Learning Approaches for Predicting In-Hospital Sepsis Mortalitycited by 2
- 2025Multi-scale Masked Autoencoder for Electrocardiogram Anomaly Detectioncited by 2
- 2023A Knowledge Distillation Approach for Sepsis Outcome Prediction from Multivariate Clinical Time Seriescited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025From Filters to VLMs: Benchmarking Defogging Methods through Object Detection and Segmentation Performancecited by 3
- 2026TimingLLM: A Two-Stage Retrieval-Augmented Framework for Pre-Synthesis Timing Prediction from Verilogcited by 1
- 2025PULSE-ICU: A Pretrained Unified Long-Sequence Encoder for Multi-task Prediction in Intensive Care Unitscited by 0
- 2026TimingLLM: A Two-Stage Retrieval-Augmented Framework for Pre-Synthesis Timing Prediction from Verilog26 Apr 2026
- 2025PULSE-ICU: A Pretrained Unified Long-Sequence Encoder for Multi-task Prediction in Intensive Care Units27 Nov 2025
- 2025From Filters to VLMs: Benchmarking Defogging Methods through Object Detection and Segmentation Performance4 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Clinically Interpretable Sepsis Early Warning via LLM-Guided Simulation of Temporal Physiological Dynamics
- 2026Attention-Based Offline Reinforcement Learning and Clustering for Interpretable Sepsis Treatment
- 2019Sepsis World Model: A MIMIC-based OpenAI Gym "World Model" Simulator for Sepsis Treatment
- 2026A Multimodal Deep Learning Framework for Predicting ICU Deterioration: Integrating ECG Waveforms with Clinical Data and Clinician Benchmarking
- 2025SepsisSuite: Beyond Risk Stratification -- A Comparative Analysis of Deep Fusion vs. Expert Stacking for Prescriptive Sepsis AI
- 2025Think as a Doctor: An Interpretable AI Approach for ICU Mortality Prediction
- 2024Enhancing In-Hospital Mortality Prediction Using Multi-Representational Learning with LLM-Generated Expert Summaries
- 2025Multimodal Forecasting of Sparse Intraoperative Hypotension Events Powered by Language Model