DeepJoint: Robust Survival Modelling Under Clinical Presence Shift
Not on the map. Why?
Abstract (arXiv)
Observational data in medicine arise as a result of the complex interaction between patients and the healthcare system. The sampling process is often highly irregular and itself constitutes an informative process. When using such data to develop prediction models, this phenomenon is often ignored, leading to sub-optimal performance and generalisability of models when practices evolve. We propose a multi-task recurrent neural network which models three clinical presence dimensions -- namely the longitudinal, the inter-observation and the missingness processes -- in parallel to the survival outcome. On a prediction task using MIMIC III laboratory tests, explicit modelling of these three processes showed improved performance in comparison to state-of-the-art predictive models (C-index at 1 day horizon: 0.878). More importantly, the proposed approach was more robust to change in the clinical presence setting, demonstrated by performance comparison between patients admitted on weekdays and weekends. This analysis demonstrates the importance of studying and leveraging clinical presence to improve performance and create more transportable clinical models.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 23 of its 72 references that are in the map. First posted on arXiv 26 May 2022.
Builds on
23 of 72 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
- 2018End-to-End Multi-Task Learning with Attentioncited by 533
- 2020Learning under Concept Drift: A Reviewcited by 470
- 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 364
- 2016DeepSurv: Personalized Treatment Recommender System Using A Cox Proportional Hazards Deep Neural Networkcited by 354
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
- 2018Scalable and accurate deep learning for electronic health recordscited by 275
- 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 205
- 2015The Benefit of Multitask Representation Learningcited by 194
- 2019Latent ODEs for Irregularly-Sampled Time Seriescited by 182
11 more
- 2019MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-IIIcited by 121
- 2017Modeling The Intensity Function Of Point Process Via Recurrent Neural Networkscited by 93
- 2019Interpolation-Prediction Networks for Irregularly Sampled Time Seriescited by 89
- 2016Modeling Missing Data in Clinical Time Series with RNNscited by 80
- 2019Feature Robustness in Non-stationary Health Records: Caveats to Deployable Model Performance in Common Clinical Machine Learning Taskscited by 39
- 2016DeepCare: A Deep Dynamic Memory Model for Predictive Medicinecited by 32
- 2017Discrete Event, Continuous Time RNNscited by 31
- 2017Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosiscited by 18
- 2018Medical Concept Embedding with Time-Aware Attentioncited by 11
- 2020Improving Irregularly Sampled Time Series Learning with Dense Descriptors of Timecited by 5
- 2018Mixed effects models for healthcare longitudinal data with an informative visiting process: a Monte Carlo simulation studycited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 2.
5 papers.
- 2023Accounting For Informative Sampling When Learning to Forecast Treatment Outcomes Over Timecited by 14
- 2022Imputation Strategies Under Clinical Presence: Impact on Algorithmic Fairnesscited by 6
- 2024Robust prediction under missingness shiftscited by 1
- 2024SeqRisk: Transformer-augmented latent variable model for robust survival prediction with longitudinal datacited by 1
- 2022EDEN : An Event DEtection Network for the annotation of Breast Cancer recurrences in administrative claims datacited by 0
- 2024SeqRisk: Transformer-augmented latent variable model for robust survival prediction with longitudinal data19 Sep 2024
- 2024Robust prediction under missingness shifts24 Jun 2024
- 2023Accounting For Informative Sampling When Learning to Forecast Treatment Outcomes Over Time7 Jun 2023
- 2022EDEN : An Event DEtection Network for the annotation of Breast Cancer recurrences in administrative claims data15 Nov 2022
- 2022Imputation Strategies Under Clinical Presence: Impact on Algorithmic Fairness13 Aug 2022